Aug 16 10:25:19 user nova-compute[73067]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 16 10:25:21 user nova-compute[73067]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73067) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 10:25:21 user nova-compute[73067]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73067) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 10:25:21 user nova-compute[73067]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73067) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 10:25:21 user nova-compute[73067]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:25:22 user nova-compute[73067]: INFO nova.virt.driver [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 16 10:25:22 user nova-compute[73067]: INFO nova.compute.provider_config [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] Acquiring lock "singleton_lock" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] Acquired lock "singleton_lock" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] Releasing lock "singleton_lock" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] Full set of CONF: {{(pid=73067) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ******************************************************************************** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] Configuration options gathered from: {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ================================================================================ {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] allow_resize_to_same_host      = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] arq_binding_timeout            = 300 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] backdoor_port                  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] backdoor_socket                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] block_device_allocate_retries  = 300 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] block_device_allocate_retries_interval = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cert                           = self.pem {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute_monitors               = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] config_dir                     = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] config_drive_format            = iso9660 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] config_source                  = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] console_host                   = user {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] control_exchange               = nova {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cpu_allocation_ratio           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] daemon                         = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] debug                          = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] default_access_ip_network_name = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] default_availability_zone      = nova {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] default_ephemeral_format       = ext4 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] default_schedule_zone          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] disk_allocation_ratio          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] enable_new_services            = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] enabled_ssl_apis               = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] flat_injected                  = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] force_config_drive             = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] force_raw_images               = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] graceful_shutdown_timeout      = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] heal_instance_info_cache_interval = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] host                           = user {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] instance_build_timeout         = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] instance_delete_interval       = 300 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] instance_name_template         = instance-%08x {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] instance_usage_audit           = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] instance_usage_audit_period    = month {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] internal_service_availability_zone = internal {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] key                            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] live_migration_retry_count     = 30 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] log_config_append              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] log_dir                        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] log_file                       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] log_options                    = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] log_rotate_interval            = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] log_rotate_interval_type       = days {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] log_rotation_type              = none {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] long_rpc_timeout               = 1800 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] max_concurrent_builds          = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] max_concurrent_live_migrations = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] max_concurrent_snapshots       = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] max_local_block_devices        = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] max_logfile_count              = 30 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] max_logfile_size_mb            = 200 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] maximum_instance_delete_attempts = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] metadata_listen                = 0.0.0.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] metadata_listen_port           = 8775 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] metadata_workers               = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] migrate_max_retries            = -1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] mkisofs_cmd                    = genisoimage {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] my_ip                          = 10.0.0.210 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] network_allocate_retries       = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] osapi_compute_listen_port      = 8774 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] osapi_compute_unique_server_name_scope =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] osapi_compute_workers          = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] password_length                = 12 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] periodic_enable                = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] periodic_fuzzy_delay           = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] pointer_model                  = ps2mouse {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] preallocate_images             = none {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] publish_errors                 = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] pybasedir                      = /opt/stack/nova {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ram_allocation_ratio           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] rate_limit_burst               = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] rate_limit_except_level        = CRITICAL {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] rate_limit_interval            = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] reboot_timeout                 = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] reclaim_instance_interval      = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] record                         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] reimage_timeout_per_gb         = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] report_interval                = 120 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] rescue_timeout                 = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] reserved_host_cpus             = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] reserved_host_disk_mb          = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] reserved_host_memory_mb        = 512 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] reserved_huge_pages            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] resize_confirm_window          = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] resize_fs_using_block_device   = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] resume_guests_state_on_host_boot = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] rpc_response_timeout           = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] run_external_periodic_tasks    = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] running_deleted_instance_action = reap {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] running_deleted_instance_timeout = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler_instance_sync_interval = 120 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_down_time              = 720 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] servicegroup_driver            = db {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] shelved_offload_time           = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] shelved_poll_interval          = 3600 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] shutdown_timeout               = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] source_is_ipv6                 = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ssl_only                       = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] state_path                     = /opt/stack/data/nova {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] sync_power_state_interval      = 600 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] sync_power_state_pool_size     = 1000 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] syslog_log_facility            = LOG_USER {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] tempdir                        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] timeout_nbd                    = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] transport_url                  = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] update_resources_interval      = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] use_cow_images                 = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] use_eventlog                   = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] use_journal                    = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] use_json                       = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] use_rootwrap_daemon            = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] use_stderr                     = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] use_syslog                     = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vcpu_pin_set                   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plugging_is_fatal          = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plugging_timeout           = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] virt_mkfs                      = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] volume_usage_poll_interval     = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] watch_log_file                 = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] web                            = /usr/share/spice-html5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_concurrency.disable_process_locking = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.auth_strategy              = keystone {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.compute_link_prefix        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.dhcp_domain                = novalocal {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.enable_instance_password   = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.glance_link_prefix         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.instance_list_per_project_cells = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.list_records_by_skipping_down_cells = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.local_metadata_per_cell    = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.max_limit                  = 1000 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.metadata_cache_expiration  = 15 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.neutron_default_tenant_id  = default {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.use_forwarded_for          = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.use_neutron_default_nets   = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.vendordata_dynamic_targets = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.vendordata_jsonfile_path   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.backend_argument         = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.config_prefix            = cache.oslo {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.dead_timeout             = 60.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.debug_cache_backend      = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.enable_retry_client      = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.enable_socket_keepalive  = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.enabled                  = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.expiration_time          = 600 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.hashclient_retry_attempts = 2 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.memcache_dead_retry      = 300 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.memcache_password        =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.memcache_sasl_enabled    = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.memcache_username        =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.proxies                  = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.retry_attempts           = 2 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.retry_delay              = 0.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.socket_keepalive_count   = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.socket_keepalive_idle    = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.socket_keepalive_interval = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.tls_allowed_ciphers      = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.tls_cafile               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.tls_certfile             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.tls_enabled              = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cache.tls_keyfile              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.auth_section            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.auth_type               = password {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.cafile                  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.certfile                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.collect_timing          = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.cross_az_attach         = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.debug                   = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.endpoint_template       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.http_retries            = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.insecure                = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.keyfile                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.os_region_name          = RegionOne {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.split_loggers           = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cinder.timeout                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.cpu_dedicated_set      = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.cpu_shared_set         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.image_type_exclude_list = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.resource_provider_association_refresh = 300 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.shutdown_retry_interval = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] conductor.workers              = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] console.allowed_origins        = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] console.ssl_ciphers            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] console.ssl_minimum_version    = default {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] consoleauth.token_ttl          = 600 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.cafile                  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.certfile                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.collect_timing          = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.connect_retries         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.connect_retry_delay     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.endpoint_override       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.insecure                = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.keyfile                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.max_version             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.min_version             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.region_name             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.service_name            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.service_type            = accelerator {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.split_loggers           = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.status_code_retries     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.status_code_retry_delay = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.timeout                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] cyborg.version                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.backend               = sqlalchemy {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.connection            = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.connection_debug      = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.connection_parameters =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.connection_recycle_time = 3600 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.connection_trace      = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.db_inc_retry_interval = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.db_max_retries        = 20 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.db_max_retry_interval = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.db_retry_interval     = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.max_overflow          = 50 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.max_pool_size         = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.max_retries           = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.mysql_enable_ndb      = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.mysql_wsrep_sync_wait = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.pool_timeout          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.retry_interval        = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.slave_connection      = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] database.sqlite_synchronous    = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.backend           = sqlalchemy {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.connection        = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.connection_debug  = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.connection_parameters =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.connection_recycle_time = 3600 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.connection_trace  = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.db_inc_retry_interval = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.db_max_retries    = 20 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.db_max_retry_interval = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.db_retry_interval = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.max_overflow      = 50 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.max_pool_size     = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.max_retries       = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.mysql_enable_ndb  = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.pool_timeout      = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.retry_interval    = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.slave_connection  = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] api_database.sqlite_synchronous = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] devices.enabled_mdev_types     = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ephemeral_storage_encryption.enabled = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.api_servers             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.cafile                  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.certfile                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.collect_timing          = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.connect_retries         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.connect_retry_delay     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.debug                   = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.default_trusted_certificate_ids = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.enable_certificate_validation = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.enable_rbd_download     = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.endpoint_override       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.insecure                = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.keyfile                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.max_version             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.min_version             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.num_retries             = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.rbd_ceph_conf           =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.rbd_connect_timeout     = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.rbd_pool                =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.rbd_user                =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.region_name             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.service_name            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.service_type            = image {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.split_loggers           = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.status_code_retries     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.status_code_retry_delay = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.timeout                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.verify_glance_signatures = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] glance.version                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] guestfs.debug                  = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.config_drive_cdrom      = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.config_drive_inject_password = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.enable_remotefx         = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.instances_path_share    =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.limit_cpu_features      = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.use_multipath_io        = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.vswitch_name            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] mks.enabled                    = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] image_cache.manager_interval   = 2400 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] image_cache.precache_concurrency = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] image_cache.remove_unused_base_images = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] image_cache.subdirectory_name  = _base {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.api_max_retries         = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.api_retry_interval      = 2 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.auth_section            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.auth_type               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.cafile                  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.certfile                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.collect_timing          = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.connect_retries         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.connect_retry_delay     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.endpoint_override       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.insecure                = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.keyfile                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.max_version             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.min_version             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.partition_key           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.peer_list               = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.region_name             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.serial_console_state_timeout = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.service_name            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.service_type            = baremetal {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.split_loggers           = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.status_code_retries     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.status_code_retry_delay = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.timeout                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ironic.version                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] key_manager.fixed_key          = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.barbican_api_version  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.barbican_endpoint     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.barbican_endpoint_type = public {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.barbican_region_name  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.cafile                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.certfile              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.collect_timing        = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.insecure              = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.keyfile               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.number_of_retries     = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.retry_delay           = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.send_service_user_token = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.split_loggers         = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.timeout               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.verify_ssl            = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican.verify_ssl_path       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican_service_user.auth_section = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican_service_user.auth_type = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican_service_user.cafile   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican_service_user.certfile = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican_service_user.collect_timing = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican_service_user.insecure = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican_service_user.keyfile  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican_service_user.split_loggers = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] barbican_service_user.timeout  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.approle_role_id          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.approle_secret_id        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.cafile                   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.certfile                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.collect_timing           = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.insecure                 = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.keyfile                  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.kv_mountpoint            = secret {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.kv_version               = 2 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.namespace                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.root_token_id            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.split_loggers            = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.ssl_ca_crt_file          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.timeout                  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.use_ssl                  = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.cafile                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.certfile              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.collect_timing        = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.connect_retries       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.connect_retry_delay   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.endpoint_override     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.insecure              = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.keyfile               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.max_version           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.min_version           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.region_name           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.service_name          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.service_type          = identity {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.split_loggers         = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.status_code_retries   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.status_code_retry_delay = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.timeout               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] keystone.version               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.connection_uri         =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.cpu_mode               = custom {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: WARNING oslo_config.cfg [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.cpu_power_governor_high = performance {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.cpu_power_management   = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.device_detach_attempts = 8 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.device_detach_timeout  = 20 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.disk_cachemodes        = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.disk_prefix            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.enabled_perf_events    = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.file_backed_memory     = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.gid_maps               = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.hw_disk_discard        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.hw_machine_type        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.images_rbd_pool        = rbd {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.images_type            = default {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.images_volume_group    = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.inject_key             = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.inject_partition       = -2 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.inject_password        = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.iscsi_iface            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.iser_use_multipath     = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_downtime = 500 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_inbound_addr = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_scheme  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_timeout_action = abort {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_tunnelled = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: WARNING oslo_config.cfg [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 16 10:25:22 user nova-compute[73067]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 16 10:25:22 user nova-compute[73067]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 16 10:25:22 user nova-compute[73067]: and ``live_migration_inbound_addr`` respectively.
Aug 16 10:25:22 user nova-compute[73067]: ).  Its value may be silently ignored in the future.
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.live_migration_with_native_tls = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.max_queues             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.nfs_mount_options      = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.num_pcie_ports         = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.pmem_namespaces        = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.quobyte_client_cfg     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.rbd_secret_uuid        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.rbd_user               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.rescue_image_id        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.rescue_kernel_id       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.rx_queue_size          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.smbfs_mount_options    =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.snapshot_compression   = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.snapshot_image_format  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.sparse_logical_volumes = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.swtpm_enabled          = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.swtpm_group            = tss {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.swtpm_user             = tss {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.sysinfo_serial         = unique {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.tb_cache_size          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.tx_queue_size          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.uid_maps               = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.use_virtio_for_bridges = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.virt_type              = kvm {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.volume_clear           = zero {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.volume_clear_size      = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.volume_use_multipath   = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.vzstorage_cache_path   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.auth_section           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.auth_type              = password {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.cafile                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.certfile               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.collect_timing         = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.connect_retries        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.connect_retry_delay    = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.default_floating_pool  = public {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.endpoint_override      = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.extension_sync_interval = 600 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.http_retries           = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.insecure               = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.keyfile                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.max_version            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.min_version            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.ovs_bridge             = br-int {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.physnets               = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.region_name            = RegionOne {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.service_metadata_proxy = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.service_name           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.service_type           = network {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.split_loggers          = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.status_code_retries    = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.status_code_retry_delay = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.timeout                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] neutron.version                = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] notifications.bdms_in_notifications = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] notifications.default_level    = INFO {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] notifications.notification_format = unversioned {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] notifications.notify_on_state_change = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] pci.alias                      = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] pci.device_spec                = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] pci.report_in_placement        = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.auth_section         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.auth_type            = password {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.cafile               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.certfile             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.collect_timing       = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.connect_retries      = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.connect_retry_delay  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.default_domain_id    = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.default_domain_name  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.domain_id            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.domain_name          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.endpoint_override    = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.insecure             = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.keyfile              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.max_version          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.min_version          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.password             = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.project_domain_id    = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.project_domain_name  = Default {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.project_id           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.project_name         = service {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.region_name          = RegionOne {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.service_name         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.service_type         = placement {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.split_loggers        = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.status_code_retries  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.status_code_retry_delay = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.system_scope         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.timeout              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.trust_id             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.user_domain_id       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.user_domain_name     = Default {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.user_id              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.username             = placement {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] placement.version              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.cores                    = 20 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.count_usage_from_placement = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.injected_file_content_bytes = 10240 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.injected_file_path_length = 255 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.injected_files           = 5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.instances                = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.key_pairs                = 100 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.metadata_items           = 128 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.ram                      = 51200 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.recheck_quota            = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.server_group_members     = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] quota.server_groups            = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] rdp.enabled                    = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.image_metadata_prefilter = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.max_attempts         = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.max_placement_results = 1000 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] scheduler.workers              = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.host_subset_size = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.isolated_hosts = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.isolated_images = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.pci_in_placement = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.track_instance_changes = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] metrics.required               = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] metrics.weight_multiplier      = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] metrics.weight_setting         = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] serial_console.enabled         = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] serial_console.port_range      = 10000:20000 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] serial_console.serialproxy_port = 6083 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_user.auth_section      = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_user.auth_type         = password {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_user.cafile            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_user.certfile          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_user.collect_timing    = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_user.insecure          = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_user.keyfile           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_user.send_service_user_token = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_user.split_loggers     = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] service_user.timeout           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.agent_enabled            = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.enabled                  = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.html5proxy_port          = 6082 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.image_compression        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.jpeg_compression         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.playback_compression     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.server_listen            = 127.0.0.1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.streaming_mode           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] spice.zlib_compression         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] upgrade_levels.baseapi         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] upgrade_levels.cert            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] upgrade_levels.compute         = auto {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] upgrade_levels.conductor       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] upgrade_levels.scheduler       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vendordata_dynamic_auth.cafile = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vendordata_dynamic_auth.certfile = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vendordata_dynamic_auth.insecure = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vendordata_dynamic_auth.timeout = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.api_retry_count         = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.ca_file                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.cache_prefix            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.cluster_name            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.connection_pool_size    = 10 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.console_delay_seconds   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.datastore_regex         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.host_ip                 = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.host_password           = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.host_port               = 443 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.host_username           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.insecure                = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.integration_bridge      = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.maximum_objects         = 100 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.pbm_default_policy      = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.pbm_enabled             = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.pbm_wsdl_location       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.serial_port_proxy_uri   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.serial_port_service_uri = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.task_poll_interval      = 0.5 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.use_linked_clone        = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.vnc_keymap              = en-us {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.vnc_port                = 5900 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vmware.vnc_port_total          = 10000 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vnc.auth_schemes               = ['none'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vnc.enabled                    = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vnc.novncproxy_port            = 6080 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vnc.vencrypt_ca_certs          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vnc.vencrypt_client_cert       = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vnc.vencrypt_client_key        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.disable_rootwrap   = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.enable_numa_live_migration = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.libvirt_disable_apic = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.client_socket_timeout     = 900 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.default_pool_size         = 1000 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.keep_alive                = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.max_header_line           = 16384 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.ssl_ca_file               = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.ssl_cert_file             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.ssl_key_file              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.tcp_keepidle              = 600 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] zvm.ca_file                    = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] zvm.cloud_connector_url        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] zvm.reachable_timeout          = 300 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_policy.enforce_new_defaults = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_policy.enforce_scope      = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_policy.policy_default_rule = default {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.connection_string     = messaging:// {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.enabled               = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.es_doc_type           = notification {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.es_scroll_size        = 10000 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.es_scroll_time        = 2m {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.filter_error_trace    = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.hmac_keys             = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.sentinel_service_name = mymaster {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.socket_timeout        = 0.1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.trace_requests        = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler.trace_sqlalchemy      = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler_jaeger.process_tags   = {} {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler_jaeger.service_name_prefix = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] profiler_otlp.service_name_prefix = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] remote_debug.host              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] remote_debug.port              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_notifications.retry = -1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.auth_section        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.auth_type           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.cafile              = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.certfile            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.collect_timing      = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.connect_retries     = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.connect_retry_delay = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.endpoint_id         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.endpoint_override   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.insecure            = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.keyfile             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.max_version         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.min_version         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.region_name         = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.service_name        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.service_type        = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.split_loggers       = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.status_code_retries = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.status_code_retry_delay = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.timeout             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.valid_interfaces    = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_limit.version             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_reports.file_event_handler = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] oslo_reports.log_dir           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_ovs_privileged.group  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] vif_plug_ovs_privileged.user   = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_ovs.isolate_vif         = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] os_brick.lock_path             = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] privsep_osbrick.capabilities   = [21] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] privsep_osbrick.group          = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] privsep_osbrick.helper_command = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] privsep_osbrick.user           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] nova_sys_admin.group           = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] nova_sys_admin.helper_command  = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] nova_sys_admin.user            = None {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG oslo_service.service [None req-8598a4dc-1242-46b5-93eb-1f7d500b7533 None None] ******************************************************************************** {{(pid=73067) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 16 10:25:22 user nova-compute[73067]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 16 10:25:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Starting native event thread {{(pid=73067) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Starting green dispatch thread {{(pid=73067) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Starting connection event dispatch thread {{(pid=73067) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Connecting to libvirt: qemu:///system {{(pid=73067) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f3588208f10> {{(pid=73067) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 16 10:25:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f3588208f10> {{(pid=73067) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 16 10:25:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Connection event '1' reason 'None'
Aug 16 10:25:22 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 10:25:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.mount [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Initialising _HostMountState generation 0 {{(pid=73067) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 16 10:25:29 user nova-compute[73067]: INFO nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Libvirt host capabilities <capabilities>
Aug 16 10:25:29 user nova-compute[73067]:   <host>
Aug 16 10:25:29 user nova-compute[73067]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 16 10:25:29 user nova-compute[73067]:     <cpu>
Aug 16 10:25:29 user nova-compute[73067]:       <arch>x86_64</arch>
Aug 16 10:25:29 user nova-compute[73067]:       <model>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <vendor>Intel</vendor>
Aug 16 10:25:29 user nova-compute[73067]:       <microcode version='1070'/>
Aug 16 10:25:29 user nova-compute[73067]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 16 10:25:29 user nova-compute[73067]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='ss'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='vmx'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='pcid'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='osxsave'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='hypervisor'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='arat'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='tsc_adjust'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='md-clear'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='arch-capabilities'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='invtsc'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='rsba'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature name='skip-l1dfl-vmentry'/>
Aug 16 10:25:29 user nova-compute[73067]:       <pages unit='KiB' size='4'/>
Aug 16 10:25:29 user nova-compute[73067]:       <pages unit='KiB' size='2048'/>
Aug 16 10:25:29 user nova-compute[73067]:     </cpu>
Aug 16 10:25:29 user nova-compute[73067]:     <power_management>
Aug 16 10:25:29 user nova-compute[73067]:       <suspend_mem/>
Aug 16 10:25:29 user nova-compute[73067]:       <suspend_disk/>
Aug 16 10:25:29 user nova-compute[73067]:       <suspend_hybrid/>
Aug 16 10:25:29 user nova-compute[73067]:     </power_management>
Aug 16 10:25:29 user nova-compute[73067]:     <iommu support='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     <migration_features>
Aug 16 10:25:29 user nova-compute[73067]:       <live/>
Aug 16 10:25:29 user nova-compute[73067]:       <uri_transports>
Aug 16 10:25:29 user nova-compute[73067]:         <uri_transport>tcp</uri_transport>
Aug 16 10:25:29 user nova-compute[73067]:         <uri_transport>rdma</uri_transport>
Aug 16 10:25:29 user nova-compute[73067]:       </uri_transports>
Aug 16 10:25:29 user nova-compute[73067]:     </migration_features>
Aug 16 10:25:29 user nova-compute[73067]:     <topology>
Aug 16 10:25:29 user nova-compute[73067]:       <cells num='2'>
Aug 16 10:25:29 user nova-compute[73067]:         <cell id='0'>
Aug 16 10:25:29 user nova-compute[73067]:           <memory unit='KiB'>8140616</memory>
Aug 16 10:25:29 user nova-compute[73067]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 16 10:25:29 user nova-compute[73067]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 10:25:29 user nova-compute[73067]:           <distances>
Aug 16 10:25:29 user nova-compute[73067]:             <sibling id='0' value='10'/>
Aug 16 10:25:29 user nova-compute[73067]:             <sibling id='1' value='20'/>
Aug 16 10:25:29 user nova-compute[73067]:           </distances>
Aug 16 10:25:29 user nova-compute[73067]:           <cpus num='6'>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 16 10:25:29 user nova-compute[73067]:           </cpus>
Aug 16 10:25:29 user nova-compute[73067]:         </cell>
Aug 16 10:25:29 user nova-compute[73067]:         <cell id='1'>
Aug 16 10:25:29 user nova-compute[73067]:           <memory unit='KiB'>8255068</memory>
Aug 16 10:25:29 user nova-compute[73067]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 16 10:25:29 user nova-compute[73067]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 10:25:29 user nova-compute[73067]:           <distances>
Aug 16 10:25:29 user nova-compute[73067]:             <sibling id='0' value='20'/>
Aug 16 10:25:29 user nova-compute[73067]:             <sibling id='1' value='10'/>
Aug 16 10:25:29 user nova-compute[73067]:           </distances>
Aug 16 10:25:29 user nova-compute[73067]:           <cpus num='6'>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 16 10:25:29 user nova-compute[73067]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 16 10:25:29 user nova-compute[73067]:           </cpus>
Aug 16 10:25:29 user nova-compute[73067]:         </cell>
Aug 16 10:25:29 user nova-compute[73067]:       </cells>
Aug 16 10:25:29 user nova-compute[73067]:     </topology>
Aug 16 10:25:29 user nova-compute[73067]:     <cache>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 16 10:25:29 user nova-compute[73067]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 16 10:25:29 user nova-compute[73067]:     </cache>
Aug 16 10:25:29 user nova-compute[73067]:     <secmodel>
Aug 16 10:25:29 user nova-compute[73067]:       <model>apparmor</model>
Aug 16 10:25:29 user nova-compute[73067]:       <doi>0</doi>
Aug 16 10:25:29 user nova-compute[73067]:     </secmodel>
Aug 16 10:25:29 user nova-compute[73067]:     <secmodel>
Aug 16 10:25:29 user nova-compute[73067]:       <model>dac</model>
Aug 16 10:25:29 user nova-compute[73067]:       <doi>0</doi>
Aug 16 10:25:29 user nova-compute[73067]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 16 10:25:29 user nova-compute[73067]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 16 10:25:29 user nova-compute[73067]:     </secmodel>
Aug 16 10:25:29 user nova-compute[73067]:   </host>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='alpha'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>clipper</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='armv6l'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>spitz</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>nuri</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>kzm</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sx1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>z2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>tosa</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>n810</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>n800</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>terrier</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>midway</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>microbit</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>verdex</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>highbank</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>akita</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>connex</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>collie</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='armv7l'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>spitz</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>nuri</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>kzm</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sx1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>z2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>tosa</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>n810</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>n800</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>terrier</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>midway</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>microbit</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>verdex</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>highbank</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>akita</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>connex</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>collie</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='aarch64'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>spitz</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>nuri</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>kzm</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sx1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>z2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>tosa</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>n810</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>n800</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>terrier</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>midway</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>microbit</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>verdex</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>raspi3b</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>highbank</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>akita</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>connex</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>collie</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <acpi default='on' toggle='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='cris'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='i686'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>isapc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>microvm</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='kvm'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <pae/>
Aug 16 10:25:29 user nova-compute[73067]:       <nonpae/>
Aug 16 10:25:29 user nova-compute[73067]:       <acpi default='on' toggle='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:       <apic default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='m68k'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>an5206</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>q800</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>next-cube</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='microblaze'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='microblazeel'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='mips'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='16'>malta</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='mipsel'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='16'>malta</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='mips64'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='16'>malta</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>pica61</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>magnum</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='mips64el'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='16'>malta</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>pica61</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>magnum</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='16'>boston</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='ppc'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mac99</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>40p</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>taihu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='ppc64'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>taihu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>40p</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mac99</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='ppc64le'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>taihu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>40p</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>mac99</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='riscv32'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='8'>spike</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>opentitan</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='8'>virt</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='riscv64'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='8'>spike</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>shakti_c</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='8'>virt</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='s390x'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='sh4'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>shix</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>r2d</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='sh4eb'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>shix</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>r2d</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='sparc'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>SS-5</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>SS-20</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>LX</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>SS-4</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>SS-10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>Voyager</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='sparc64'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sun4u</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>niagara</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>sun4v</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='x86_64'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>64</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='1'>isapc</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>microvm</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='kvm'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <acpi default='on' toggle='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:       <apic default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='xtensa'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>sim</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>kc705</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>ml605</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>virt</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>lx200</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>lx60</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]:   <guest>
Aug 16 10:25:29 user nova-compute[73067]:     <os_type>hvm</os_type>
Aug 16 10:25:29 user nova-compute[73067]:     <arch name='xtensaeb'>
Aug 16 10:25:29 user nova-compute[73067]:       <wordsize>32</wordsize>
Aug 16 10:25:29 user nova-compute[73067]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='4'>sim</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>kc705</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>ml605</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>virt</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>lx200</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>lx60</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 10:25:29 user nova-compute[73067]:       <domain type='qemu'/>
Aug 16 10:25:29 user nova-compute[73067]:     </arch>
Aug 16 10:25:29 user nova-compute[73067]:     <features>
Aug 16 10:25:29 user nova-compute[73067]:       <cpuselection/>
Aug 16 10:25:29 user nova-compute[73067]:       <deviceboot/>
Aug 16 10:25:29 user nova-compute[73067]:       <disksnapshot default='on' toggle='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     </features>
Aug 16 10:25:29 user nova-compute[73067]:   </guest>
Aug 16 10:25:29 user nova-compute[73067]: </capabilities>
Aug 16 10:25:29 user nova-compute[73067]: 
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 16 10:25:29 user nova-compute[73067]: <domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 10:25:29 user nova-compute[73067]:   <domain>kvm</domain>
Aug 16 10:25:29 user nova-compute[73067]:   <machine>pc-q35-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:   <arch>i686</arch>
Aug 16 10:25:29 user nova-compute[73067]:   <vcpu max='288'/>
Aug 16 10:25:29 user nova-compute[73067]:   <iothreads supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:   <os supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='firmware'/>
Aug 16 10:25:29 user nova-compute[73067]:     <loader supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>rom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pflash</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='readonly'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>yes</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='secure'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </loader>
Aug 16 10:25:29 user nova-compute[73067]:   </os>
Aug 16 10:25:29 user nova-compute[73067]:   <cpu>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-passthrough' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='hostPassthroughMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='maximum' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='maximumMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-model' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <vendor>Intel</vendor>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ss'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='vmx'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pcid'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='hypervisor'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arat'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='umip'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='md-clear'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibpb'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibrs'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='erms'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='lm'/>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='custom' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>qemu64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>qemu32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>phenom</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>n270</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>kvm64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>coreduo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>core2duo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>athlon</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Westmere</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Snowridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Penryn</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G5</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G4</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G1</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Nehalem</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Rome</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Milan</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Dhyana</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cooperlake</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Conroe</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>486</model>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:   </cpu>
Aug 16 10:25:29 user nova-compute[73067]:   <memoryBacking supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='sourceType'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>file</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>anonymous</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>memfd</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:   </memoryBacking>
Aug 16 10:25:29 user nova-compute[73067]:   <devices>
Aug 16 10:25:29 user nova-compute[73067]:     <disk supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='diskDevice'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>disk</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cdrom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>floppy</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>lun</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='bus'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>fdc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sata</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </disk>
Aug 16 10:25:29 user nova-compute[73067]:     <graphics supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sdl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vnc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>spice</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egl-headless</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </graphics>
Aug 16 10:25:29 user nova-compute[73067]:     <video supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='modelType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cirrus</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vmvga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>qxl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>none</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>bochs</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ramfb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </video>
Aug 16 10:25:29 user nova-compute[73067]:     <hostdev supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='mode'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>subsystem</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='startupPolicy'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>default</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>mandatory</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>requisite</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>optional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='subsysType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pci</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='capsType'/>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='pciBackend'/>
Aug 16 10:25:29 user nova-compute[73067]:     </hostdev>
Aug 16 10:25:29 user nova-compute[73067]:     <rng supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>random</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egd</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>builtin</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </rng>
Aug 16 10:25:29 user nova-compute[73067]:     <filesystem supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='driverType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>path</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>handle</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtiofs</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </filesystem>
Aug 16 10:25:29 user nova-compute[73067]:     <tpm supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-tis</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-crb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>passthrough</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>emulator</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </tpm>
Aug 16 10:25:29 user nova-compute[73067]:   </devices>
Aug 16 10:25:29 user nova-compute[73067]:   <features>
Aug 16 10:25:29 user nova-compute[73067]:     <gic supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     <vmcoreinfo supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <genid supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backingStoreInput supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backup supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <sev supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:   </features>
Aug 16 10:25:29 user nova-compute[73067]: </domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:  {{(pid=73067) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 16 10:25:29 user nova-compute[73067]: <domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 10:25:29 user nova-compute[73067]:   <domain>kvm</domain>
Aug 16 10:25:29 user nova-compute[73067]:   <machine>pc-q35-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:   <arch>i686</arch>
Aug 16 10:25:29 user nova-compute[73067]:   <vcpu max='288'/>
Aug 16 10:25:29 user nova-compute[73067]:   <iothreads supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:   <os supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='firmware'/>
Aug 16 10:25:29 user nova-compute[73067]:     <loader supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>rom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pflash</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='readonly'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>yes</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='secure'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </loader>
Aug 16 10:25:29 user nova-compute[73067]:   </os>
Aug 16 10:25:29 user nova-compute[73067]:   <cpu>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-passthrough' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='hostPassthroughMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='maximum' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='maximumMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-model' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <vendor>Intel</vendor>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ss'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='vmx'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pcid'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='hypervisor'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arat'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='umip'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='md-clear'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibpb'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibrs'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='erms'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='lm'/>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='custom' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>qemu64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>qemu32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>phenom</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>n270</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>kvm64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>coreduo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>core2duo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>athlon</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Westmere</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Snowridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Penryn</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G5</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G4</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G1</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Nehalem</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Rome</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Milan</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Dhyana</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cooperlake</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Conroe</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>486</model>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:   </cpu>
Aug 16 10:25:29 user nova-compute[73067]:   <memoryBacking supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='sourceType'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>file</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>anonymous</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>memfd</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:   </memoryBacking>
Aug 16 10:25:29 user nova-compute[73067]:   <devices>
Aug 16 10:25:29 user nova-compute[73067]:     <disk supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='diskDevice'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>disk</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cdrom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>floppy</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>lun</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='bus'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>fdc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sata</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </disk>
Aug 16 10:25:29 user nova-compute[73067]:     <graphics supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sdl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vnc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>spice</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egl-headless</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </graphics>
Aug 16 10:25:29 user nova-compute[73067]:     <video supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='modelType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cirrus</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vmvga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>qxl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>none</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>bochs</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ramfb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </video>
Aug 16 10:25:29 user nova-compute[73067]:     <hostdev supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='mode'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>subsystem</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='startupPolicy'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>default</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>mandatory</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>requisite</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>optional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='subsysType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pci</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='capsType'/>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='pciBackend'/>
Aug 16 10:25:29 user nova-compute[73067]:     </hostdev>
Aug 16 10:25:29 user nova-compute[73067]:     <rng supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>random</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egd</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>builtin</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </rng>
Aug 16 10:25:29 user nova-compute[73067]:     <filesystem supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='driverType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>path</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>handle</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtiofs</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </filesystem>
Aug 16 10:25:29 user nova-compute[73067]:     <tpm supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-tis</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-crb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>passthrough</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>emulator</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </tpm>
Aug 16 10:25:29 user nova-compute[73067]:   </devices>
Aug 16 10:25:29 user nova-compute[73067]:   <features>
Aug 16 10:25:29 user nova-compute[73067]:     <gic supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     <vmcoreinfo supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <genid supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backingStoreInput supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backup supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <sev supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:   </features>
Aug 16 10:25:29 user nova-compute[73067]: </domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:  {{(pid=73067) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 16 10:25:29 user nova-compute[73067]: <domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 10:25:29 user nova-compute[73067]:   <domain>kvm</domain>
Aug 16 10:25:29 user nova-compute[73067]:   <machine>pc-i440fx-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:   <arch>i686</arch>
Aug 16 10:25:29 user nova-compute[73067]:   <vcpu max='255'/>
Aug 16 10:25:29 user nova-compute[73067]:   <iothreads supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:   <os supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='firmware'/>
Aug 16 10:25:29 user nova-compute[73067]:     <loader supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>rom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pflash</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='readonly'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>yes</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='secure'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </loader>
Aug 16 10:25:29 user nova-compute[73067]:   </os>
Aug 16 10:25:29 user nova-compute[73067]:   <cpu>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-passthrough' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='hostPassthroughMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='maximum' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='maximumMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-model' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <vendor>Intel</vendor>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ss'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='vmx'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pcid'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='hypervisor'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arat'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='umip'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='md-clear'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibpb'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibrs'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='erms'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='lm'/>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='custom' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>qemu64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>qemu32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>phenom</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>n270</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>kvm64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>coreduo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>core2duo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>athlon</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Westmere</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Snowridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Penryn</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G5</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G4</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G1</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Nehalem</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Rome</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Milan</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Dhyana</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cooperlake</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Conroe</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>486</model>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:   </cpu>
Aug 16 10:25:29 user nova-compute[73067]:   <memoryBacking supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='sourceType'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>file</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>anonymous</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>memfd</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:   </memoryBacking>
Aug 16 10:25:29 user nova-compute[73067]:   <devices>
Aug 16 10:25:29 user nova-compute[73067]:     <disk supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='diskDevice'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>disk</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cdrom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>floppy</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>lun</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='bus'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ide</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>fdc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sata</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </disk>
Aug 16 10:25:29 user nova-compute[73067]:     <graphics supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sdl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vnc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>spice</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egl-headless</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </graphics>
Aug 16 10:25:29 user nova-compute[73067]:     <video supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='modelType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cirrus</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vmvga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>qxl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>none</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>bochs</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ramfb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </video>
Aug 16 10:25:29 user nova-compute[73067]:     <hostdev supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='mode'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>subsystem</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='startupPolicy'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>default</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>mandatory</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>requisite</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>optional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='subsysType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pci</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='capsType'/>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='pciBackend'/>
Aug 16 10:25:29 user nova-compute[73067]:     </hostdev>
Aug 16 10:25:29 user nova-compute[73067]:     <rng supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>random</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egd</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>builtin</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </rng>
Aug 16 10:25:29 user nova-compute[73067]:     <filesystem supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='driverType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>path</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>handle</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtiofs</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </filesystem>
Aug 16 10:25:29 user nova-compute[73067]:     <tpm supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-tis</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-crb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>passthrough</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>emulator</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </tpm>
Aug 16 10:25:29 user nova-compute[73067]:   </devices>
Aug 16 10:25:29 user nova-compute[73067]:   <features>
Aug 16 10:25:29 user nova-compute[73067]:     <gic supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     <vmcoreinfo supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <genid supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backingStoreInput supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backup supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <sev supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:   </features>
Aug 16 10:25:29 user nova-compute[73067]: </domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:  {{(pid=73067) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 16 10:25:29 user nova-compute[73067]: <domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 10:25:29 user nova-compute[73067]:   <domain>kvm</domain>
Aug 16 10:25:29 user nova-compute[73067]:   <machine>pc-i440fx-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:   <arch>i686</arch>
Aug 16 10:25:29 user nova-compute[73067]:   <vcpu max='255'/>
Aug 16 10:25:29 user nova-compute[73067]:   <iothreads supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:   <os supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='firmware'/>
Aug 16 10:25:29 user nova-compute[73067]:     <loader supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>rom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pflash</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='readonly'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>yes</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='secure'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </loader>
Aug 16 10:25:29 user nova-compute[73067]:   </os>
Aug 16 10:25:29 user nova-compute[73067]:   <cpu>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-passthrough' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='hostPassthroughMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='maximum' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='maximumMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-model' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <vendor>Intel</vendor>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ss'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='vmx'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pcid'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='hypervisor'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arat'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='umip'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='md-clear'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibpb'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibrs'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='erms'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='lm'/>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='custom' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>qemu64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>qemu32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>phenom</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>n270</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>kvm64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>coreduo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>core2duo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>athlon</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Westmere</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Snowridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Penryn</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G5</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G4</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G1</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Nehalem</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Rome</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Milan</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Dhyana</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cooperlake</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Conroe</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>486</model>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:   </cpu>
Aug 16 10:25:29 user nova-compute[73067]:   <memoryBacking supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='sourceType'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>file</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>anonymous</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>memfd</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:   </memoryBacking>
Aug 16 10:25:29 user nova-compute[73067]:   <devices>
Aug 16 10:25:29 user nova-compute[73067]:     <disk supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='diskDevice'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>disk</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cdrom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>floppy</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>lun</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='bus'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ide</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>fdc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sata</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </disk>
Aug 16 10:25:29 user nova-compute[73067]:     <graphics supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sdl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vnc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>spice</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egl-headless</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </graphics>
Aug 16 10:25:29 user nova-compute[73067]:     <video supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='modelType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cirrus</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vmvga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>qxl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>none</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>bochs</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ramfb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </video>
Aug 16 10:25:29 user nova-compute[73067]:     <hostdev supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='mode'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>subsystem</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='startupPolicy'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>default</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>mandatory</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>requisite</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>optional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='subsysType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pci</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='capsType'/>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='pciBackend'/>
Aug 16 10:25:29 user nova-compute[73067]:     </hostdev>
Aug 16 10:25:29 user nova-compute[73067]:     <rng supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>random</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egd</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>builtin</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </rng>
Aug 16 10:25:29 user nova-compute[73067]:     <filesystem supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='driverType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>path</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>handle</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtiofs</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </filesystem>
Aug 16 10:25:29 user nova-compute[73067]:     <tpm supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-tis</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-crb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>passthrough</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>emulator</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </tpm>
Aug 16 10:25:29 user nova-compute[73067]:   </devices>
Aug 16 10:25:29 user nova-compute[73067]:   <features>
Aug 16 10:25:29 user nova-compute[73067]:     <gic supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     <vmcoreinfo supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <genid supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backingStoreInput supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backup supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <sev supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:   </features>
Aug 16 10:25:29 user nova-compute[73067]: </domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:  {{(pid=73067) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 16 10:25:29 user nova-compute[73067]: <domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 10:25:29 user nova-compute[73067]:   <domain>kvm</domain>
Aug 16 10:25:29 user nova-compute[73067]:   <machine>pc-q35-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:   <arch>x86_64</arch>
Aug 16 10:25:29 user nova-compute[73067]:   <vcpu max='288'/>
Aug 16 10:25:29 user nova-compute[73067]:   <iothreads supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:   <os supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='firmware'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>efi</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:     <loader supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>rom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pflash</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='readonly'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>yes</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='secure'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>yes</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </loader>
Aug 16 10:25:29 user nova-compute[73067]:   </os>
Aug 16 10:25:29 user nova-compute[73067]:   <cpu>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-passthrough' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='hostPassthroughMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='maximum' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='maximumMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-model' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <vendor>Intel</vendor>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ss'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='vmx'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pcid'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='hypervisor'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arat'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='umip'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='md-clear'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='invtsc'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibpb'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibrs'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='rsba'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='erms'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='custom' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>qemu64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>qemu32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>phenom</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>n270</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>coreduo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>core2duo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>athlon</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Westmere</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Snowridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Penryn</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G5</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G4</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Opteron_G1</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Nehalem</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Rome</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Milan</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Dhyana</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cooperlake</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Conroe</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>486</model>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:   </cpu>
Aug 16 10:25:29 user nova-compute[73067]:   <memoryBacking supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='sourceType'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>file</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>anonymous</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>memfd</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:   </memoryBacking>
Aug 16 10:25:29 user nova-compute[73067]:   <devices>
Aug 16 10:25:29 user nova-compute[73067]:     <disk supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='diskDevice'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>disk</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cdrom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>floppy</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>lun</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='bus'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>fdc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sata</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </disk>
Aug 16 10:25:29 user nova-compute[73067]:     <graphics supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sdl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vnc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>spice</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egl-headless</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </graphics>
Aug 16 10:25:29 user nova-compute[73067]:     <video supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='modelType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cirrus</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vmvga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>qxl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>none</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>bochs</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ramfb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </video>
Aug 16 10:25:29 user nova-compute[73067]:     <hostdev supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='mode'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>subsystem</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='startupPolicy'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>default</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>mandatory</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>requisite</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>optional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='subsysType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pci</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='capsType'/>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='pciBackend'/>
Aug 16 10:25:29 user nova-compute[73067]:     </hostdev>
Aug 16 10:25:29 user nova-compute[73067]:     <rng supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>random</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egd</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>builtin</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </rng>
Aug 16 10:25:29 user nova-compute[73067]:     <filesystem supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='driverType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>path</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>handle</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtiofs</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </filesystem>
Aug 16 10:25:29 user nova-compute[73067]:     <tpm supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-tis</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-crb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>passthrough</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>emulator</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </tpm>
Aug 16 10:25:29 user nova-compute[73067]:   </devices>
Aug 16 10:25:29 user nova-compute[73067]:   <features>
Aug 16 10:25:29 user nova-compute[73067]:     <gic supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     <vmcoreinfo supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <genid supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backingStoreInput supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backup supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <sev supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:   </features>
Aug 16 10:25:29 user nova-compute[73067]: </domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:  {{(pid=73067) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 16 10:25:29 user nova-compute[73067]: <domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 10:25:29 user nova-compute[73067]:   <domain>kvm</domain>
Aug 16 10:25:29 user nova-compute[73067]:   <machine>pc-q35-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:   <arch>x86_64</arch>
Aug 16 10:25:29 user nova-compute[73067]:   <vcpu max='288'/>
Aug 16 10:25:29 user nova-compute[73067]:   <iothreads supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:   <os supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='firmware'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>efi</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:     <loader supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>rom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pflash</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='readonly'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>yes</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='secure'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>yes</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </loader>
Aug 16 10:25:29 user nova-compute[73067]:   </os>
Aug 16 10:25:29 user nova-compute[73067]:   <cpu>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-passthrough' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='hostPassthroughMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='maximum' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='maximumMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-model' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <vendor>Intel</vendor>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ss'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='vmx'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pcid'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='hypervisor'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arat'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='umip'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='md-clear'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='invtsc'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibpb'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibrs'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='rsba'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='erms'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='custom' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>qemu64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>qemu32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>phenom</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>n270</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>coreduo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>core2duo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>athlon</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Westmere</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Snowridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Penryn</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G5</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G4</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Opteron_G1</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Nehalem</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Rome</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Milan</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Dhyana</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cooperlake</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Conroe</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>486</model>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:   </cpu>
Aug 16 10:25:29 user nova-compute[73067]:   <memoryBacking supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='sourceType'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>file</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>anonymous</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>memfd</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:   </memoryBacking>
Aug 16 10:25:29 user nova-compute[73067]:   <devices>
Aug 16 10:25:29 user nova-compute[73067]:     <disk supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='diskDevice'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>disk</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cdrom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>floppy</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>lun</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='bus'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>fdc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sata</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </disk>
Aug 16 10:25:29 user nova-compute[73067]:     <graphics supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sdl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vnc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>spice</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egl-headless</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </graphics>
Aug 16 10:25:29 user nova-compute[73067]:     <video supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='modelType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cirrus</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vmvga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>qxl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>none</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>bochs</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ramfb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </video>
Aug 16 10:25:29 user nova-compute[73067]:     <hostdev supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='mode'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>subsystem</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='startupPolicy'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>default</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>mandatory</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>requisite</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>optional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='subsysType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pci</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='capsType'/>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='pciBackend'/>
Aug 16 10:25:29 user nova-compute[73067]:     </hostdev>
Aug 16 10:25:29 user nova-compute[73067]:     <rng supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>random</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egd</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>builtin</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </rng>
Aug 16 10:25:29 user nova-compute[73067]:     <filesystem supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='driverType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>path</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>handle</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtiofs</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </filesystem>
Aug 16 10:25:29 user nova-compute[73067]:     <tpm supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-tis</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-crb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>passthrough</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>emulator</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </tpm>
Aug 16 10:25:29 user nova-compute[73067]:   </devices>
Aug 16 10:25:29 user nova-compute[73067]:   <features>
Aug 16 10:25:29 user nova-compute[73067]:     <gic supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     <vmcoreinfo supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <genid supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backingStoreInput supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backup supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <sev supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:   </features>
Aug 16 10:25:29 user nova-compute[73067]: </domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:  {{(pid=73067) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 16 10:25:29 user nova-compute[73067]: <domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 10:25:29 user nova-compute[73067]:   <domain>kvm</domain>
Aug 16 10:25:29 user nova-compute[73067]:   <machine>pc-i440fx-6.2</machine>
Aug 16 10:25:29 user nova-compute[73067]:   <arch>x86_64</arch>
Aug 16 10:25:29 user nova-compute[73067]:   <vcpu max='255'/>
Aug 16 10:25:29 user nova-compute[73067]:   <iothreads supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:   <os supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='firmware'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>efi</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:     <loader supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>rom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pflash</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='readonly'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>yes</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='secure'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </loader>
Aug 16 10:25:29 user nova-compute[73067]:   </os>
Aug 16 10:25:29 user nova-compute[73067]:   <cpu>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-passthrough' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='hostPassthroughMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='maximum' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='maximumMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-model' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <vendor>Intel</vendor>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ss'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='vmx'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pcid'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='hypervisor'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arat'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='umip'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='md-clear'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='invtsc'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibpb'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibrs'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='rsba'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='erms'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='custom' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>qemu64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>qemu32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>phenom</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>n270</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>coreduo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>core2duo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>athlon</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Westmere</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Snowridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Penryn</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G5</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G4</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Opteron_G1</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Nehalem</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Rome</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Milan</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Dhyana</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cooperlake</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Conroe</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>486</model>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:   </cpu>
Aug 16 10:25:29 user nova-compute[73067]:   <memoryBacking supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='sourceType'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>file</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>anonymous</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>memfd</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:   </memoryBacking>
Aug 16 10:25:29 user nova-compute[73067]:   <devices>
Aug 16 10:25:29 user nova-compute[73067]:     <disk supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='diskDevice'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>disk</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cdrom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>floppy</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>lun</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='bus'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ide</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>fdc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sata</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </disk>
Aug 16 10:25:29 user nova-compute[73067]:     <graphics supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sdl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vnc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>spice</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egl-headless</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </graphics>
Aug 16 10:25:29 user nova-compute[73067]:     <video supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='modelType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cirrus</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vmvga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>qxl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>none</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>bochs</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ramfb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </video>
Aug 16 10:25:29 user nova-compute[73067]:     <hostdev supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='mode'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>subsystem</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='startupPolicy'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>default</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>mandatory</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>requisite</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>optional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='subsysType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pci</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='capsType'/>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='pciBackend'/>
Aug 16 10:25:29 user nova-compute[73067]:     </hostdev>
Aug 16 10:25:29 user nova-compute[73067]:     <rng supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>random</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egd</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>builtin</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </rng>
Aug 16 10:25:29 user nova-compute[73067]:     <filesystem supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='driverType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>path</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>handle</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtiofs</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </filesystem>
Aug 16 10:25:29 user nova-compute[73067]:     <tpm supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-tis</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-crb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>passthrough</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>emulator</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </tpm>
Aug 16 10:25:29 user nova-compute[73067]:   </devices>
Aug 16 10:25:29 user nova-compute[73067]:   <features>
Aug 16 10:25:29 user nova-compute[73067]:     <gic supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     <vmcoreinfo supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <genid supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backingStoreInput supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backup supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <sev supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:   </features>
Aug 16 10:25:29 user nova-compute[73067]: </domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:  {{(pid=73067) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 16 10:25:29 user nova-compute[73067]: <domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 10:25:29 user nova-compute[73067]:   <domain>kvm</domain>
Aug 16 10:25:29 user nova-compute[73067]:   <machine>pc-i440fx-jammy</machine>
Aug 16 10:25:29 user nova-compute[73067]:   <arch>x86_64</arch>
Aug 16 10:25:29 user nova-compute[73067]:   <vcpu max='255'/>
Aug 16 10:25:29 user nova-compute[73067]:   <iothreads supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:   <os supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='firmware'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>efi</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:     <loader supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>rom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pflash</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='readonly'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>yes</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='secure'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>no</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </loader>
Aug 16 10:25:29 user nova-compute[73067]:   </os>
Aug 16 10:25:29 user nova-compute[73067]:   <cpu>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-passthrough' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='hostPassthroughMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='maximum' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='maximumMigratable'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>on</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>off</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='host-model' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <vendor>Intel</vendor>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ss'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='vmx'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pcid'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='hypervisor'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arat'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='umip'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='md-clear'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='invtsc'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibpb'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='ibrs'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-stibp'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='rsba'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='erms'/>
Aug 16 10:25:29 user nova-compute[73067]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:     <mode name='custom' supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>qemu64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>qemu32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>phenom</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>pentium</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>n270</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm64</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>kvm32</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>coreduo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>core2duo</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>athlon</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Westmere</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Snowridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Skylake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>SandyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Penryn</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G5</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G4</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G3</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Opteron_G2</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Opteron_G1</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Nehalem</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>IvyBridge</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Icelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Haswell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Rome</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-Milan</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>EPYC</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Dhyana</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cooperlake</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>Conroe</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='no'>Broadwell</model>
Aug 16 10:25:29 user nova-compute[73067]:       <model usable='yes'>486</model>
Aug 16 10:25:29 user nova-compute[73067]:     </mode>
Aug 16 10:25:29 user nova-compute[73067]:   </cpu>
Aug 16 10:25:29 user nova-compute[73067]:   <memoryBacking supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:     <enum name='sourceType'>
Aug 16 10:25:29 user nova-compute[73067]:       <value>file</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>anonymous</value>
Aug 16 10:25:29 user nova-compute[73067]:       <value>memfd</value>
Aug 16 10:25:29 user nova-compute[73067]:     </enum>
Aug 16 10:25:29 user nova-compute[73067]:   </memoryBacking>
Aug 16 10:25:29 user nova-compute[73067]:   <devices>
Aug 16 10:25:29 user nova-compute[73067]:     <disk supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='diskDevice'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>disk</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cdrom</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>floppy</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>lun</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='bus'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ide</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>fdc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sata</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </disk>
Aug 16 10:25:29 user nova-compute[73067]:     <graphics supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='type'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>sdl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vnc</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>spice</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egl-headless</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </graphics>
Aug 16 10:25:29 user nova-compute[73067]:     <video supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='modelType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>cirrus</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>vmvga</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>qxl</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>none</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>bochs</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>ramfb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </video>
Aug 16 10:25:29 user nova-compute[73067]:     <hostdev supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='mode'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>subsystem</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='startupPolicy'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>default</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>mandatory</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>requisite</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>optional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='subsysType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>usb</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>pci</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>scsi</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='capsType'/>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='pciBackend'/>
Aug 16 10:25:29 user nova-compute[73067]:     </hostdev>
Aug 16 10:25:29 user nova-compute[73067]:     <rng supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtio-non-transitional</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>random</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>egd</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>builtin</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </rng>
Aug 16 10:25:29 user nova-compute[73067]:     <filesystem supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='driverType'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>path</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>handle</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>virtiofs</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </filesystem>
Aug 16 10:25:29 user nova-compute[73067]:     <tpm supported='yes'>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='model'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-tis</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>tpm-crb</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:       <enum name='backendModel'>
Aug 16 10:25:29 user nova-compute[73067]:         <value>passthrough</value>
Aug 16 10:25:29 user nova-compute[73067]:         <value>emulator</value>
Aug 16 10:25:29 user nova-compute[73067]:       </enum>
Aug 16 10:25:29 user nova-compute[73067]:     </tpm>
Aug 16 10:25:29 user nova-compute[73067]:   </devices>
Aug 16 10:25:29 user nova-compute[73067]:   <features>
Aug 16 10:25:29 user nova-compute[73067]:     <gic supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:     <vmcoreinfo supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <genid supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backingStoreInput supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <backup supported='yes'/>
Aug 16 10:25:29 user nova-compute[73067]:     <sev supported='no'/>
Aug 16 10:25:29 user nova-compute[73067]:   </features>
Aug 16 10:25:29 user nova-compute[73067]: </domainCapabilities>
Aug 16 10:25:29 user nova-compute[73067]:  {{(pid=73067) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73067) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73067) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Checking secure boot support for host arch (x86_64) {{(pid=73067) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 10:25:29 user nova-compute[73067]: INFO nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Secure Boot support detected
Aug 16 10:25:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] cpu compare xml: <cpu match="exact">
Aug 16 10:25:29 user nova-compute[73067]:   <model>Nehalem</model>
Aug 16 10:25:29 user nova-compute[73067]: </cpu>
Aug 16 10:25:29 user nova-compute[73067]:  {{(pid=73067) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 16 10:25:29 user nova-compute[73067]: INFO nova.virt.node [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Generated node identity 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f
Aug 16 10:25:29 user nova-compute[73067]: INFO nova.virt.node [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Wrote node identity 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f to /opt/stack/data/nova/compute_id
Aug 16 10:25:30 user nova-compute[73067]: WARNING nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Compute nodes ['7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 16 10:25:30 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 16 10:25:30 user nova-compute[73067]: WARNING nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 10:25:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:25:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:25:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:25:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:25:30 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:25:30 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:25:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Hypervisor/Node resource view: name=user free_ram=10859MB free_disk=26.249919891357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:25:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:25:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:25:30 user nova-compute[73067]: WARNING nova.compute.resource_tracker [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] No compute node record for user:7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f could not be found.
Aug 16 10:25:30 user nova-compute[73067]: INFO nova.compute.resource_tracker [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Compute node record created for user:user with uuid: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f
Aug 16 10:25:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:25:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:25:30 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [req-40788d09-4368-4eb2-9cda-7ae19b93bd3c] Created resource provider record via placement API for resource provider with UUID 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f and name user.
Aug 16 10:25:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73067) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 16 10:25:30 user nova-compute[73067]: INFO nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] kernel doesn't support AMD SEV
Aug 16 10:25:30 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 10:25:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:25:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Libvirt baseline CPU <cpu>
Aug 16 10:25:30 user nova-compute[73067]:   <arch>x86_64</arch>
Aug 16 10:25:30 user nova-compute[73067]:   <model>Nehalem</model>
Aug 16 10:25:30 user nova-compute[73067]:   <vendor>Intel</vendor>
Aug 16 10:25:30 user nova-compute[73067]:   <topology sockets="6" cores="1" threads="1"/>
Aug 16 10:25:30 user nova-compute[73067]: </cpu>
Aug 16 10:25:30 user nova-compute[73067]:  {{(pid=73067) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 16 10:25:31 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Updated inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 16 10:25:31 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Updating resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f generation from 0 to 1 during operation: update_inventory {{(pid=73067) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 10:25:31 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 10:25:31 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Updating resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f generation from 1 to 2 during operation: update_traits {{(pid=73067) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 10:25:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:25:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.773s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:25:31 user nova-compute[73067]: DEBUG nova.service [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Creating RPC server for service compute {{(pid=73067) start /opt/stack/nova/nova/service.py:182}}
Aug 16 10:25:31 user nova-compute[73067]: DEBUG nova.service [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Join ServiceGroup membership for this service compute {{(pid=73067) start /opt/stack/nova/nova/service.py:199}}
Aug 16 10:25:31 user nova-compute[73067]: DEBUG nova.servicegroup.drivers.db [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73067) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 16 10:25:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:25:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:26:22 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:26:22 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=10225MB free_disk=26.15362548828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:26:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:27:22 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:27:22 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:27:22 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=10205MB free_disk=26.199684143066406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:27:22 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:27:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:27:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:28:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:28:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:28:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:28:24 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:28:24 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:28:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=10178MB free_disk=25.983783721923828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:28:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:28:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:28:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:29:24 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:29:24 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:29:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=9458MB free_disk=26.006450653076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:29:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:29:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 10:29:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 10:29:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:29:26 user nova-compute[73067]: INFO nova.compute.claims [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Claim successful on node user
Aug 16 10:29:26 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:29:26 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:29:27 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:29:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:29:27 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:29:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:29:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:29:27 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Creating image(s)
Aug 16 10:29:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "/opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "/opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:27 user nova-compute[73067]: DEBUG nova.policy [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddc3b33d1210437fbbfcbcd33afa134a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4317072d4b7f45d5bb9149fd878620c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:29:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832.part --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832.part --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:28 user nova-compute[73067]: DEBUG nova.virt.images [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] 8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58 was qcow2, converting to raw {{(pid=73067) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 10:29:28 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:29:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832.part /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832.converted {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832.part /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832.converted" returned: 0 in 0.147s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832.converted --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.655s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:28 user nova-compute[73067]: INFO oslo.privsep.daemon [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7y8wrmuq/privsep.sock']
Aug 16 10:29:28 user sudo[82287]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7y8wrmuq/privsep.sock
Aug 16 10:29:28 user sudo[82287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 10:29:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Successfully created port: 0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:29:30 user sudo[82287]: pam_unix(sudo:session): session closed for user root
Aug 16 10:29:30 user nova-compute[73067]: INFO oslo.privsep.daemon [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Spawned new privsep daemon via rootwrap
Aug 16 10:29:30 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 10:29:30 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 10:29:30 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 16 10:29:30 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82340
Aug 16 10:29:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.207s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Successfully updated port: 0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "refresh_cache-1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquired lock "refresh_cache-1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk 1073741824" returned: 0 in 0.051s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d56a3515-f38e-4d04-9d49-ca8f7f577ec6 req-8b637d5a-2430-4404-a8a0-d5f68be4fb53 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Received event network-changed-0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d56a3515-f38e-4d04-9d49-ca8f7f577ec6 req-8b637d5a-2430-4404-a8a0-d5f68be4fb53 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Refreshing instance network info cache due to event network-changed-0c460a72-6515-44f6-80d4-5a682c43a834. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d56a3515-f38e-4d04-9d49-ca8f7f577ec6 req-8b637d5a-2430-4404-a8a0-d5f68be4fb53 service nova] Acquiring lock "refresh_cache-1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Cannot resize image /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lazy-loading 'migration_context' on Instance uuid 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Ensure instance console log exists: /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Updating instance_info_cache with network_info: [{"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Releasing lock "refresh_cache-1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Instance network_info: |[{"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d56a3515-f38e-4d04-9d49-ca8f7f577ec6 req-8b637d5a-2430-4404-a8a0-d5f68be4fb53 service nova] Acquired lock "refresh_cache-1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-d56a3515-f38e-4d04-9d49-ca8f7f577ec6 req-8b637d5a-2430-4404-a8a0-d5f68be4fb53 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Refreshing network info cache for port 0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Start _get_guest_xml network_info=[{"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:29:32 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:29:32 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2023417787',display_name='tempest-DeleteServersTestJSON-server-2023417787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2023417787',id=1,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4317072d4b7f45d5bb9149fd878620c8',ramdisk_id='',reservation_id='r-39vtr0kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-379304192',owner_user_name='tempest-DeleteServersTestJSON-379304192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:29:27Z,user_data=None,user_id='ddc3b33d1210437fbbfcbcd33afa134a',uuid=1d4b626f-b793-4cf2-b6f9-4bd0fb16947f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Converting VIF {"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=0c460a72-6515-44f6-80d4-5a682c43a834,network=Network(c979bcb0-b5ad-43ca-a5c3-959a0888dd02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c460a72-65') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.objects.instance [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:29:32 user nova-compute[73067]:   <uuid>1d4b626f-b793-4cf2-b6f9-4bd0fb16947f</uuid>
Aug 16 10:29:32 user nova-compute[73067]:   <name>instance-00000001</name>
Aug 16 10:29:32 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:29:32 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:29:32 user nova-compute[73067]:   <metadata>
Aug 16 10:29:32 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:29:32 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:29:32 user nova-compute[73067]:       <nova:name>tempest-DeleteServersTestJSON-server-2023417787</nova:name>
Aug 16 10:29:32 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:29:32</nova:creationTime>
Aug 16 10:29:32 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:29:32 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:29:32 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:29:32 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:29:32 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:29:32 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:29:32 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:29:32 user nova-compute[73067]:       <nova:owner>
Aug 16 10:29:32 user nova-compute[73067]:         <nova:user uuid="ddc3b33d1210437fbbfcbcd33afa134a">tempest-DeleteServersTestJSON-379304192-project-member</nova:user>
Aug 16 10:29:32 user nova-compute[73067]:         <nova:project uuid="4317072d4b7f45d5bb9149fd878620c8">tempest-DeleteServersTestJSON-379304192</nova:project>
Aug 16 10:29:32 user nova-compute[73067]:       </nova:owner>
Aug 16 10:29:32 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:29:32 user nova-compute[73067]:       <nova:ports>
Aug 16 10:29:32 user nova-compute[73067]:         <nova:port uuid="0c460a72-6515-44f6-80d4-5a682c43a834">
Aug 16 10:29:32 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 10:29:32 user nova-compute[73067]:         </nova:port>
Aug 16 10:29:32 user nova-compute[73067]:       </nova:ports>
Aug 16 10:29:32 user nova-compute[73067]:     </nova:instance>
Aug 16 10:29:32 user nova-compute[73067]:   </metadata>
Aug 16 10:29:32 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:29:32 user nova-compute[73067]:     <system>
Aug 16 10:29:32 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:29:32 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:29:32 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:29:32 user nova-compute[73067]:       <entry name="serial">1d4b626f-b793-4cf2-b6f9-4bd0fb16947f</entry>
Aug 16 10:29:32 user nova-compute[73067]:       <entry name="uuid">1d4b626f-b793-4cf2-b6f9-4bd0fb16947f</entry>
Aug 16 10:29:32 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:29:32 user nova-compute[73067]:     </system>
Aug 16 10:29:32 user nova-compute[73067]:   </sysinfo>
Aug 16 10:29:32 user nova-compute[73067]:   <os>
Aug 16 10:29:32 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:29:32 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:29:32 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:29:32 user nova-compute[73067]:   </os>
Aug 16 10:29:32 user nova-compute[73067]:   <features>
Aug 16 10:29:32 user nova-compute[73067]:     <acpi/>
Aug 16 10:29:32 user nova-compute[73067]:     <apic/>
Aug 16 10:29:32 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:29:32 user nova-compute[73067]:   </features>
Aug 16 10:29:32 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:29:32 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:29:32 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:29:32 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:29:32 user nova-compute[73067]:   </clock>
Aug 16 10:29:32 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:29:32 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:29:32 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:29:32 user nova-compute[73067]:   </cpu>
Aug 16 10:29:32 user nova-compute[73067]:   <devices>
Aug 16 10:29:32 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:29:32 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:29:32 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk"/>
Aug 16 10:29:32 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:29:32 user nova-compute[73067]:     </disk>
Aug 16 10:29:32 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:29:32 user nova-compute[73067]:       <mac address="fa:16:3e:30:2c:35"/>
Aug 16 10:29:32 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:29:32 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:29:32 user nova-compute[73067]:       <target dev="tap0c460a72-65"/>
Aug 16 10:29:32 user nova-compute[73067]:     </interface>
Aug 16 10:29:32 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:29:32 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/console.log" append="off"/>
Aug 16 10:29:32 user nova-compute[73067]:     </serial>
Aug 16 10:29:32 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:29:32 user nova-compute[73067]:     <video>
Aug 16 10:29:32 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:29:32 user nova-compute[73067]:     </video>
Aug 16 10:29:32 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:29:32 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:29:32 user nova-compute[73067]:     </rng>
Aug 16 10:29:32 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:29:32 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:29:32 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:29:32 user nova-compute[73067]:     </memballoon>
Aug 16 10:29:32 user nova-compute[73067]:   </devices>
Aug 16 10:29:32 user nova-compute[73067]: </domain>
Aug 16 10:29:32 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2023417787',display_name='tempest-DeleteServersTestJSON-server-2023417787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2023417787',id=1,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4317072d4b7f45d5bb9149fd878620c8',ramdisk_id='',reservation_id='r-39vtr0kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-379304192',owner_user_name='tempest-DeleteServersTestJSON-379304192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:29:27Z,user_data=None,user_id='ddc3b33d1210437fbbfcbcd33afa134a',uuid=1d4b626f-b793-4cf2-b6f9-4bd0fb16947f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Converting VIF {"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=0c460a72-6515-44f6-80d4-5a682c43a834,network=Network(c979bcb0-b5ad-43ca-a5c3-959a0888dd02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c460a72-65') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG os_vif [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=0c460a72-6515-44f6-80d4-5a682c43a834,network=Network(c979bcb0-b5ad-43ca-a5c3-959a0888dd02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c460a72-65') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Created schema index Interface.name {{(pid=73067) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Created schema index Port.name {{(pid=73067) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Created schema index Bridge.name {{(pid=73067) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [POLLOUT] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:29:32 user nova-compute[73067]: INFO oslo.privsep.daemon [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpy3x9h83a/privsep.sock']
Aug 16 10:29:32 user sudo[82359]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpy3x9h83a/privsep.sock
Aug 16 10:29:32 user sudo[82359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 10:29:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-d56a3515-f38e-4d04-9d49-ca8f7f577ec6 req-8b637d5a-2430-4404-a8a0-d5f68be4fb53 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Updated VIF entry in instance network info cache for port 0c460a72-6515-44f6-80d4-5a682c43a834. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:29:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-d56a3515-f38e-4d04-9d49-ca8f7f577ec6 req-8b637d5a-2430-4404-a8a0-d5f68be4fb53 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Updating instance_info_cache with network_info: [{"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:29:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d56a3515-f38e-4d04-9d49-ca8f7f577ec6 req-8b637d5a-2430-4404-a8a0-d5f68be4fb53 service nova] Releasing lock "refresh_cache-1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:29:34 user sudo[82359]: pam_unix(sudo:session): session closed for user root
Aug 16 10:29:34 user nova-compute[73067]: INFO oslo.privsep.daemon [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Spawned new privsep daemon via rootwrap
Aug 16 10:29:34 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 10:29:34 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 10:29:34 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 16 10:29:34 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82362
Aug 16 10:29:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c460a72-65, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c460a72-65, col_values=(('external_ids', {'iface-id': '0c460a72-6515-44f6-80d4-5a682c43a834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:2c:35', 'vm-uuid': '1d4b626f-b793-4cf2-b6f9-4bd0fb16947f'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:29:35 user nova-compute[73067]: INFO os_vif [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=0c460a72-6515-44f6-80d4-5a682c43a834,network=Network(c979bcb0-b5ad-43ca-a5c3-959a0888dd02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c460a72-65')
Aug 16 10:29:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:29:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] No VIF found with MAC fa:16:3e:30:2c:35, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:29:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:29:36 user nova-compute[73067]: INFO nova.compute.claims [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Claim successful on node user
Aug 16 10:29:36 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:29:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:29:36 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:29:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:29:37 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Creating image(s)
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "/opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "/opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "/opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.203s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG nova.policy [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c965df8f8c240438581033b9004bea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56c1ffc9f4b4b63a31c6020cdc12f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk 1073741824" returned: 0 in 0.050s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.245s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Cannot resize image /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG nova.objects.instance [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lazy-loading 'migration_context' on Instance uuid b51879a0-d5a1-4f96-b0c1-0672d31e80db {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Ensure instance console log exists: /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181778.104743, 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:29:38 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] VM Resumed (Lifecycle Event)
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:29:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Instance spawned successfully.
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:29:38 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181778.1247842, 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:29:38 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] VM Started (Lifecycle Event)
Aug 16 10:29:38 user nova-compute[73067]: INFO nova.compute.manager [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Took 11.08 seconds to spawn the instance on the hypervisor.
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:29:38 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:29:38 user nova-compute[73067]: INFO nova.compute.manager [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Took 11.91 seconds to build instance.
Aug 16 10:29:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ff99c05-4241-4c36-b92c-16d93ebfe7b5 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.160s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "311f3d35-c279-4b63-b3e1-7528c30ac659" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:29:41 user nova-compute[73067]: INFO nova.compute.claims [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Claim successful on node user
Aug 16 10:29:41 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Successfully created port: e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:29:41 user nova-compute[73067]: DEBUG nova.network.neutron [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:29:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:29:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:29:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Creating image(s)
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "/opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "/opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "/opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG nova.policy [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e4cbf9cec1c4c438adbbab6bd7f794c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7b37f1cdfe41ddb6545c23a5b5c8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.268s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:29:42 user nova-compute[73067]: INFO nova.compute.claims [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Claim successful on node user
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.223s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk 1073741824" returned: 0 in 0.061s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.283s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:29:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:29:43 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Cannot resize image /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'migration_context' on Instance uuid 311f3d35-c279-4b63-b3e1-7528c30ac659 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Ensure instance console log exists: /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:29:43 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Creating image(s)
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG nova.policy [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70bcfa5c264949eaa13c3f7620340b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a85655eedd4d9c9aeb5320fa880c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.270s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.211s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk 1073741824" returned: 0 in 0.055s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.190s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Cannot resize image /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'migration_context' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Ensure instance console log exists: /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:45 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Successfully created port: c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:29:46 user nova-compute[73067]: DEBUG nova.network.neutron [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Successfully created port: 3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:29:46 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Successfully updated port: e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:29:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:29:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquired lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:29:46 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:29:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-95882533-2ab3-4592-a9ef-75be5dce4afe req-6c95b045-2c55-4749-a0fc-564a1f0d6761 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Received event network-changed-e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:29:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-95882533-2ab3-4592-a9ef-75be5dce4afe req-6c95b045-2c55-4749-a0fc-564a1f0d6761 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Refreshing instance network info cache due to event network-changed-e67ff481-da2d-4922-9c80-dd085c42cc05. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:29:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-95882533-2ab3-4592-a9ef-75be5dce4afe req-6c95b045-2c55-4749-a0fc-564a1f0d6761 service nova] Acquiring lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:29:47 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Updating instance_info_cache with network_info: [{"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Releasing lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Instance network_info: |[{"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-95882533-2ab3-4592-a9ef-75be5dce4afe req-6c95b045-2c55-4749-a0fc-564a1f0d6761 service nova] Acquired lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.network.neutron [req-95882533-2ab3-4592-a9ef-75be5dce4afe req-6c95b045-2c55-4749-a0fc-564a1f0d6761 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Refreshing network info cache for port e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Start _get_guest_xml network_info=[{"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:29:48 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:29:48 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1979248196',display_name='tempest-ServersNegativeTestJSON-server-1979248196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1979248196',id=2,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c1ffc9f4b4b63a31c6020cdc12f96',ramdisk_id='',reservation_id='r-0gj05vdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-29460834',owner_user_name='tempest-ServersNegativeTestJSON-29460834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:29:37Z,user_data=None,user_id='7c965df8f8c240438581033b9004bea3',uuid=b51879a0-d5a1-4f96-b0c1-0672d31e80db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converting VIF {"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:47:ac,bridge_name='br-int',has_traffic_filtering=True,id=e67ff481-da2d-4922-9c80-dd085c42cc05,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67ff481-da') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lazy-loading 'pci_devices' on Instance uuid b51879a0-d5a1-4f96-b0c1-0672d31e80db {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:29:48 user nova-compute[73067]:   <uuid>b51879a0-d5a1-4f96-b0c1-0672d31e80db</uuid>
Aug 16 10:29:48 user nova-compute[73067]:   <name>instance-00000002</name>
Aug 16 10:29:48 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:29:48 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:29:48 user nova-compute[73067]:   <metadata>
Aug 16 10:29:48 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:29:48 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:29:48 user nova-compute[73067]:       <nova:name>tempest-ServersNegativeTestJSON-server-1979248196</nova:name>
Aug 16 10:29:48 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:29:48</nova:creationTime>
Aug 16 10:29:48 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:29:48 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:29:48 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:29:48 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:29:48 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:29:48 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:29:48 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:29:48 user nova-compute[73067]:       <nova:owner>
Aug 16 10:29:48 user nova-compute[73067]:         <nova:user uuid="7c965df8f8c240438581033b9004bea3">tempest-ServersNegativeTestJSON-29460834-project-member</nova:user>
Aug 16 10:29:48 user nova-compute[73067]:         <nova:project uuid="c56c1ffc9f4b4b63a31c6020cdc12f96">tempest-ServersNegativeTestJSON-29460834</nova:project>
Aug 16 10:29:48 user nova-compute[73067]:       </nova:owner>
Aug 16 10:29:48 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:29:48 user nova-compute[73067]:       <nova:ports>
Aug 16 10:29:48 user nova-compute[73067]:         <nova:port uuid="e67ff481-da2d-4922-9c80-dd085c42cc05">
Aug 16 10:29:48 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 10:29:48 user nova-compute[73067]:         </nova:port>
Aug 16 10:29:48 user nova-compute[73067]:       </nova:ports>
Aug 16 10:29:48 user nova-compute[73067]:     </nova:instance>
Aug 16 10:29:48 user nova-compute[73067]:   </metadata>
Aug 16 10:29:48 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:29:48 user nova-compute[73067]:     <system>
Aug 16 10:29:48 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:29:48 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:29:48 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:29:48 user nova-compute[73067]:       <entry name="serial">b51879a0-d5a1-4f96-b0c1-0672d31e80db</entry>
Aug 16 10:29:48 user nova-compute[73067]:       <entry name="uuid">b51879a0-d5a1-4f96-b0c1-0672d31e80db</entry>
Aug 16 10:29:48 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:29:48 user nova-compute[73067]:     </system>
Aug 16 10:29:48 user nova-compute[73067]:   </sysinfo>
Aug 16 10:29:48 user nova-compute[73067]:   <os>
Aug 16 10:29:48 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:29:48 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:29:48 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:29:48 user nova-compute[73067]:   </os>
Aug 16 10:29:48 user nova-compute[73067]:   <features>
Aug 16 10:29:48 user nova-compute[73067]:     <acpi/>
Aug 16 10:29:48 user nova-compute[73067]:     <apic/>
Aug 16 10:29:48 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:29:48 user nova-compute[73067]:   </features>
Aug 16 10:29:48 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:29:48 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:29:48 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:29:48 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:29:48 user nova-compute[73067]:   </clock>
Aug 16 10:29:48 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:29:48 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:29:48 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:29:48 user nova-compute[73067]:   </cpu>
Aug 16 10:29:48 user nova-compute[73067]:   <devices>
Aug 16 10:29:48 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:29:48 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:29:48 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk"/>
Aug 16 10:29:48 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:29:48 user nova-compute[73067]:     </disk>
Aug 16 10:29:48 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:29:48 user nova-compute[73067]:       <mac address="fa:16:3e:2a:47:ac"/>
Aug 16 10:29:48 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:29:48 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:29:48 user nova-compute[73067]:       <target dev="tape67ff481-da"/>
Aug 16 10:29:48 user nova-compute[73067]:     </interface>
Aug 16 10:29:48 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:29:48 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/console.log" append="off"/>
Aug 16 10:29:48 user nova-compute[73067]:     </serial>
Aug 16 10:29:48 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:29:48 user nova-compute[73067]:     <video>
Aug 16 10:29:48 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:29:48 user nova-compute[73067]:     </video>
Aug 16 10:29:48 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:29:48 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:29:48 user nova-compute[73067]:     </rng>
Aug 16 10:29:48 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:29:48 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:29:48 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:29:48 user nova-compute[73067]:     </memballoon>
Aug 16 10:29:48 user nova-compute[73067]:   </devices>
Aug 16 10:29:48 user nova-compute[73067]: </domain>
Aug 16 10:29:48 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1979248196',display_name='tempest-ServersNegativeTestJSON-server-1979248196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1979248196',id=2,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c1ffc9f4b4b63a31c6020cdc12f96',ramdisk_id='',reservation_id='r-0gj05vdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-29460834',owner_user_name='tempest-ServersNegativeTestJSON-29460834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:29:37Z,user_data=None,user_id='7c965df8f8c240438581033b9004bea3',uuid=b51879a0-d5a1-4f96-b0c1-0672d31e80db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converting VIF {"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:47:ac,bridge_name='br-int',has_traffic_filtering=True,id=e67ff481-da2d-4922-9c80-dd085c42cc05,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67ff481-da') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG os_vif [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:47:ac,bridge_name='br-int',has_traffic_filtering=True,id=e67ff481-da2d-4922-9c80-dd085c42cc05,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67ff481-da') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape67ff481-da, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape67ff481-da, col_values=(('external_ids', {'iface-id': 'e67ff481-da2d-4922-9c80-dd085c42cc05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:47:ac', 'vm-uuid': 'b51879a0-d5a1-4f96-b0c1-0672d31e80db'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:48 user nova-compute[73067]: INFO os_vif [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:47:ac,bridge_name='br-int',has_traffic_filtering=True,id=e67ff481-da2d-4922-9c80-dd085c42cc05,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67ff481-da')
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:29:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] No VIF found with MAC fa:16:3e:2a:47:ac, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Successfully updated port: c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquired lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Successfully updated port: 3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquired lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-7a2cd638-47f8-4e6e-85c7-a301c42c18cd req-c19ffc86-13ee-4ede-a3cf-145aee341e03 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received event network-changed-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-7a2cd638-47f8-4e6e-85c7-a301c42c18cd req-c19ffc86-13ee-4ede-a3cf-145aee341e03 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Refreshing instance network info cache due to event network-changed-3d884641-f0de-4b61-a8e7-c7791ec28e2d. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7a2cd638-47f8-4e6e-85c7-a301c42c18cd req-c19ffc86-13ee-4ede-a3cf-145aee341e03 service nova] Acquiring lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.network.neutron [req-95882533-2ab3-4592-a9ef-75be5dce4afe req-6c95b045-2c55-4749-a0fc-564a1f0d6761 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Updated VIF entry in instance network info cache for port e67ff481-da2d-4922-9c80-dd085c42cc05. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.network.neutron [req-95882533-2ab3-4592-a9ef-75be5dce4afe req-6c95b045-2c55-4749-a0fc-564a1f0d6761 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Updating instance_info_cache with network_info: [{"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-95882533-2ab3-4592-a9ef-75be5dce4afe req-6c95b045-2c55-4749-a0fc-564a1f0d6761 service nova] Releasing lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-7aa35205-c7e4-4df9-9b62-47e7a4c6bc25 req-758a2757-c7aa-456c-bd9f-49db5bb7a0c9 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-changed-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-7aa35205-c7e4-4df9-9b62-47e7a4c6bc25 req-758a2757-c7aa-456c-bd9f-49db5bb7a0c9 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Refreshing instance network info cache due to event network-changed-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:29:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7aa35205-c7e4-4df9-9b62-47e7a4c6bc25 req-758a2757-c7aa-456c-bd9f-49db5bb7a0c9 service nova] Acquiring lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG nova.network.neutron [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updating instance_info_cache with network_info: [{"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Releasing lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Instance network_info: |[{"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7a2cd638-47f8-4e6e-85c7-a301c42c18cd req-c19ffc86-13ee-4ede-a3cf-145aee341e03 service nova] Acquired lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG nova.network.neutron [req-7a2cd638-47f8-4e6e-85c7-a301c42c18cd req-c19ffc86-13ee-4ede-a3cf-145aee341e03 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Refreshing network info cache for port 3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Start _get_guest_xml network_info=[{"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:50 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:29:50 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:29:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-282275175',display_name='tempest-ServerActionsTestOtherA-server-282275175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-282275175',id=3,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhgla1EGudnUgMo8sp69bGCzI9KExAhN9Vh+LGcPb7ZOjWlvBFg2zY0lGwEq2wsMYNd+BUSx+LuV7e4QllhSz+KH5UmhKYnFLZT6xPiJcUN2ahr8Bxzv1S1RvOd3h/nwA==',key_name='tempest-keypair-88160896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-qvk7hj1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=311f3d35-c279-4b63-b3e1-7528c30ac659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3d884641-f0de-4b61-a8e7-c7791ec28e2d,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d884641-f0') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.objects.instance [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'pci_devices' on Instance uuid 311f3d35-c279-4b63-b3e1-7528c30ac659 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:29:51 user nova-compute[73067]:   <uuid>311f3d35-c279-4b63-b3e1-7528c30ac659</uuid>
Aug 16 10:29:51 user nova-compute[73067]:   <name>instance-00000003</name>
Aug 16 10:29:51 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:29:51 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:29:51 user nova-compute[73067]:   <metadata>
Aug 16 10:29:51 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:29:51 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:name>tempest-ServerActionsTestOtherA-server-282275175</nova:name>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:29:50</nova:creationTime>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:29:51 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:29:51 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:owner>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:user uuid="9e4cbf9cec1c4c438adbbab6bd7f794c">tempest-ServerActionsTestOtherA-1833692287-project-member</nova:user>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:project uuid="1b7b37f1cdfe41ddb6545c23a5b5c8b4">tempest-ServerActionsTestOtherA-1833692287</nova:project>
Aug 16 10:29:51 user nova-compute[73067]:       </nova:owner>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:ports>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:port uuid="3d884641-f0de-4b61-a8e7-c7791ec28e2d">
Aug 16 10:29:51 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 10:29:51 user nova-compute[73067]:         </nova:port>
Aug 16 10:29:51 user nova-compute[73067]:       </nova:ports>
Aug 16 10:29:51 user nova-compute[73067]:     </nova:instance>
Aug 16 10:29:51 user nova-compute[73067]:   </metadata>
Aug 16 10:29:51 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:29:51 user nova-compute[73067]:     <system>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="serial">311f3d35-c279-4b63-b3e1-7528c30ac659</entry>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="uuid">311f3d35-c279-4b63-b3e1-7528c30ac659</entry>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:29:51 user nova-compute[73067]:     </system>
Aug 16 10:29:51 user nova-compute[73067]:   </sysinfo>
Aug 16 10:29:51 user nova-compute[73067]:   <os>
Aug 16 10:29:51 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:29:51 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:29:51 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:29:51 user nova-compute[73067]:   </os>
Aug 16 10:29:51 user nova-compute[73067]:   <features>
Aug 16 10:29:51 user nova-compute[73067]:     <acpi/>
Aug 16 10:29:51 user nova-compute[73067]:     <apic/>
Aug 16 10:29:51 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:29:51 user nova-compute[73067]:   </features>
Aug 16 10:29:51 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:29:51 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:29:51 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:29:51 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:29:51 user nova-compute[73067]:   </clock>
Aug 16 10:29:51 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:29:51 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:29:51 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:29:51 user nova-compute[73067]:   </cpu>
Aug 16 10:29:51 user nova-compute[73067]:   <devices>
Aug 16 10:29:51 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:29:51 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:29:51 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk"/>
Aug 16 10:29:51 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:29:51 user nova-compute[73067]:     </disk>
Aug 16 10:29:51 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:29:51 user nova-compute[73067]:       <mac address="fa:16:3e:2a:e8:fd"/>
Aug 16 10:29:51 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:29:51 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:29:51 user nova-compute[73067]:       <target dev="tap3d884641-f0"/>
Aug 16 10:29:51 user nova-compute[73067]:     </interface>
Aug 16 10:29:51 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:29:51 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/console.log" append="off"/>
Aug 16 10:29:51 user nova-compute[73067]:     </serial>
Aug 16 10:29:51 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:29:51 user nova-compute[73067]:     <video>
Aug 16 10:29:51 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:29:51 user nova-compute[73067]:     </video>
Aug 16 10:29:51 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:29:51 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:29:51 user nova-compute[73067]:     </rng>
Aug 16 10:29:51 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:29:51 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:29:51 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:29:51 user nova-compute[73067]:     </memballoon>
Aug 16 10:29:51 user nova-compute[73067]:   </devices>
Aug 16 10:29:51 user nova-compute[73067]: </domain>
Aug 16 10:29:51 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-282275175',display_name='tempest-ServerActionsTestOtherA-server-282275175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-282275175',id=3,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhgla1EGudnUgMo8sp69bGCzI9KExAhN9Vh+LGcPb7ZOjWlvBFg2zY0lGwEq2wsMYNd+BUSx+LuV7e4QllhSz+KH5UmhKYnFLZT6xPiJcUN2ahr8Bxzv1S1RvOd3h/nwA==',key_name='tempest-keypair-88160896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-qvk7hj1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=311f3d35-c279-4b63-b3e1-7528c30ac659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3d884641-f0de-4b61-a8e7-c7791ec28e2d,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d884641-f0') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG os_vif [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3d884641-f0de-4b61-a8e7-c7791ec28e2d,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d884641-f0') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d884641-f0, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d884641-f0, col_values=(('external_ids', {'iface-id': '3d884641-f0de-4b61-a8e7-c7791ec28e2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:e8:fd', 'vm-uuid': '311f3d35-c279-4b63-b3e1-7528c30ac659'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:51 user nova-compute[73067]: INFO os_vif [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3d884641-f0de-4b61-a8e7-c7791ec28e2d,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d884641-f0')
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No VIF found with MAC fa:16:3e:2a:e8:fd, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updating instance_info_cache with network_info: [{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Releasing lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Instance network_info: |[{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7aa35205-c7e4-4df9-9b62-47e7a4c6bc25 req-758a2757-c7aa-456c-bd9f-49db5bb7a0c9 service nova] Acquired lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-7aa35205-c7e4-4df9-9b62-47e7a4c6bc25 req-758a2757-c7aa-456c-bd9f-49db5bb7a0c9 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Refreshing network info cache for port c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Start _get_guest_xml network_info=[{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:29:51 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:29:51 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-93500555',display_name='tempest-ServerStableDeviceRescueTest-server-93500555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-93500555',id=4,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnCGChHF3jYXGv2a0SHt5NHUCA92tAWiyv6m86NOx27TMrH8SPc4MLN1jNe9CWzd+kqNF+W4jHQLPaqZl0HDJ27dCKHPSMKrqtlGkbEQO6HvoCiRyAhtMQHATGwVjhGYw==',key_name='tempest-keypair-504698564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9a85655eedd4d9c9aeb5320fa880c5b',ramdisk_id='',reservation_id='r-gdsl9tze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1826914324',owner_user_name='tempest-ServerStableDeviceRescueTest-1826914324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bcfa5c264949eaa13c3f7620340b3c',uuid=6956e66e-229d-4f95-9d0b-d1e8c89a5360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Converting VIF {"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=c50ee3f9-3e3b-4896-a303-bdbf8153b3a1,network=Network(9466980a-cc9b-4b41-b2dc-836642bfa8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50ee3f9-3e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'pci_devices' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:29:51 user nova-compute[73067]:   <uuid>6956e66e-229d-4f95-9d0b-d1e8c89a5360</uuid>
Aug 16 10:29:51 user nova-compute[73067]:   <name>instance-00000004</name>
Aug 16 10:29:51 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:29:51 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:29:51 user nova-compute[73067]:   <metadata>
Aug 16 10:29:51 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:29:51 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-93500555</nova:name>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:29:51</nova:creationTime>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:29:51 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:29:51 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:owner>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:user uuid="70bcfa5c264949eaa13c3f7620340b3c">tempest-ServerStableDeviceRescueTest-1826914324-project-member</nova:user>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:project uuid="d9a85655eedd4d9c9aeb5320fa880c5b">tempest-ServerStableDeviceRescueTest-1826914324</nova:project>
Aug 16 10:29:51 user nova-compute[73067]:       </nova:owner>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:29:51 user nova-compute[73067]:       <nova:ports>
Aug 16 10:29:51 user nova-compute[73067]:         <nova:port uuid="c50ee3f9-3e3b-4896-a303-bdbf8153b3a1">
Aug 16 10:29:51 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 10:29:51 user nova-compute[73067]:         </nova:port>
Aug 16 10:29:51 user nova-compute[73067]:       </nova:ports>
Aug 16 10:29:51 user nova-compute[73067]:     </nova:instance>
Aug 16 10:29:51 user nova-compute[73067]:   </metadata>
Aug 16 10:29:51 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:29:51 user nova-compute[73067]:     <system>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="serial">6956e66e-229d-4f95-9d0b-d1e8c89a5360</entry>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="uuid">6956e66e-229d-4f95-9d0b-d1e8c89a5360</entry>
Aug 16 10:29:51 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:29:51 user nova-compute[73067]:     </system>
Aug 16 10:29:51 user nova-compute[73067]:   </sysinfo>
Aug 16 10:29:51 user nova-compute[73067]:   <os>
Aug 16 10:29:51 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:29:51 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:29:51 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:29:51 user nova-compute[73067]:   </os>
Aug 16 10:29:51 user nova-compute[73067]:   <features>
Aug 16 10:29:51 user nova-compute[73067]:     <acpi/>
Aug 16 10:29:51 user nova-compute[73067]:     <apic/>
Aug 16 10:29:51 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:29:51 user nova-compute[73067]:   </features>
Aug 16 10:29:51 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:29:51 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:29:51 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:29:51 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:29:51 user nova-compute[73067]:   </clock>
Aug 16 10:29:51 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:29:51 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:29:51 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:29:51 user nova-compute[73067]:   </cpu>
Aug 16 10:29:51 user nova-compute[73067]:   <devices>
Aug 16 10:29:51 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:29:51 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:29:51 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk"/>
Aug 16 10:29:51 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:29:51 user nova-compute[73067]:     </disk>
Aug 16 10:29:51 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:29:51 user nova-compute[73067]:       <mac address="fa:16:3e:46:e1:81"/>
Aug 16 10:29:51 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:29:51 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:29:51 user nova-compute[73067]:       <target dev="tapc50ee3f9-3e"/>
Aug 16 10:29:51 user nova-compute[73067]:     </interface>
Aug 16 10:29:51 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:29:51 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/console.log" append="off"/>
Aug 16 10:29:51 user nova-compute[73067]:     </serial>
Aug 16 10:29:51 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:29:51 user nova-compute[73067]:     <video>
Aug 16 10:29:51 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:29:51 user nova-compute[73067]:     </video>
Aug 16 10:29:51 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:29:51 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:29:51 user nova-compute[73067]:     </rng>
Aug 16 10:29:51 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:29:51 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:29:51 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:29:51 user nova-compute[73067]:     </memballoon>
Aug 16 10:29:51 user nova-compute[73067]:   </devices>
Aug 16 10:29:51 user nova-compute[73067]: </domain>
Aug 16 10:29:51 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-93500555',display_name='tempest-ServerStableDeviceRescueTest-server-93500555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-93500555',id=4,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnCGChHF3jYXGv2a0SHt5NHUCA92tAWiyv6m86NOx27TMrH8SPc4MLN1jNe9CWzd+kqNF+W4jHQLPaqZl0HDJ27dCKHPSMKrqtlGkbEQO6HvoCiRyAhtMQHATGwVjhGYw==',key_name='tempest-keypair-504698564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9a85655eedd4d9c9aeb5320fa880c5b',ramdisk_id='',reservation_id='r-gdsl9tze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1826914324',owner_user_name='tempest-ServerStableDeviceRescueTest-1826914324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bcfa5c264949eaa13c3f7620340b3c',uuid=6956e66e-229d-4f95-9d0b-d1e8c89a5360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Converting VIF {"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=c50ee3f9-3e3b-4896-a303-bdbf8153b3a1,network=Network(9466980a-cc9b-4b41-b2dc-836642bfa8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50ee3f9-3e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG os_vif [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=c50ee3f9-3e3b-4896-a303-bdbf8153b3a1,network=Network(9466980a-cc9b-4b41-b2dc-836642bfa8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50ee3f9-3e') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc50ee3f9-3e, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc50ee3f9-3e, col_values=(('external_ids', {'iface-id': 'c50ee3f9-3e3b-4896-a303-bdbf8153b3a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:e1:81', 'vm-uuid': '6956e66e-229d-4f95-9d0b-d1e8c89a5360'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:51 user nova-compute[73067]: INFO os_vif [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=c50ee3f9-3e3b-4896-a303-bdbf8153b3a1,network=Network(9466980a-cc9b-4b41-b2dc-836642bfa8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50ee3f9-3e')
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:29:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] No VIF found with MAC fa:16:3e:46:e1:81, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:29:52 user nova-compute[73067]: DEBUG nova.network.neutron [req-7a2cd638-47f8-4e6e-85c7-a301c42c18cd req-c19ffc86-13ee-4ede-a3cf-145aee341e03 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updated VIF entry in instance network info cache for port 3d884641-f0de-4b61-a8e7-c7791ec28e2d. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:29:52 user nova-compute[73067]: DEBUG nova.network.neutron [req-7a2cd638-47f8-4e6e-85c7-a301c42c18cd req-c19ffc86-13ee-4ede-a3cf-145aee341e03 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updating instance_info_cache with network_info: [{"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:29:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7a2cd638-47f8-4e6e-85c7-a301c42c18cd req-c19ffc86-13ee-4ede-a3cf-145aee341e03 service nova] Releasing lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:29:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:52 user nova-compute[73067]: DEBUG nova.network.neutron [req-7aa35205-c7e4-4df9-9b62-47e7a4c6bc25 req-758a2757-c7aa-456c-bd9f-49db5bb7a0c9 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updated VIF entry in instance network info cache for port c50ee3f9-3e3b-4896-a303-bdbf8153b3a1. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:29:52 user nova-compute[73067]: DEBUG nova.network.neutron [req-7aa35205-c7e4-4df9-9b62-47e7a4c6bc25 req-758a2757-c7aa-456c-bd9f-49db5bb7a0c9 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updating instance_info_cache with network_info: [{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:29:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7aa35205-c7e4-4df9-9b62-47e7a4c6bc25 req-758a2757-c7aa-456c-bd9f-49db5bb7a0c9 service nova] Releasing lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181793.0325198, b51879a0-d5a1-4f96-b0c1-0672d31e80db => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:29:53 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] VM Resumed (Lifecycle Event)
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:29:53 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Instance spawned successfully.
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:29:53 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181793.0414953, b51879a0-d5a1-4f96-b0c1-0672d31e80db => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:29:53 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] VM Started (Lifecycle Event)
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:29:53 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:29:53 user nova-compute[73067]: INFO nova.compute.manager [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Took 16.44 seconds to spawn the instance on the hypervisor.
Aug 16 10:29:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:53 user nova-compute[73067]: INFO nova.compute.manager [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Took 17.34 seconds to build instance.
Aug 16 10:29:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6c8904d2-cd6d-44b5-98dc-0d449e241bd0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.550s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-b682fc15-0c9f-4b79-9431-8c678f978d26 req-710c4399-4de5-4518-832b-b39ae272901b service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Received event network-vif-plugged-0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b682fc15-0c9f-4b79-9431-8c678f978d26 req-710c4399-4de5-4518-832b-b39ae272901b service nova] Acquiring lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b682fc15-0c9f-4b79-9431-8c678f978d26 req-710c4399-4de5-4518-832b-b39ae272901b service nova] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b682fc15-0c9f-4b79-9431-8c678f978d26 req-710c4399-4de5-4518-832b-b39ae272901b service nova] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-b682fc15-0c9f-4b79-9431-8c678f978d26 req-710c4399-4de5-4518-832b-b39ae272901b service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] No waiting events found dispatching network-vif-plugged-0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:29:57 user nova-compute[73067]: WARNING nova.compute.manager [req-b682fc15-0c9f-4b79-9431-8c678f978d26 req-710c4399-4de5-4518-832b-b39ae272901b service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Received unexpected event network-vif-plugged-0c460a72-6515-44f6-80d4-5a682c43a834 for instance with vm_state active and task_state None.
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181797.197288, 311f3d35-c279-4b63-b3e1-7528c30ac659 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] VM Resumed (Lifecycle Event)
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Instance spawned successfully.
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181797.1989431, 311f3d35-c279-4b63-b3e1-7528c30ac659 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] VM Started (Lifecycle Event)
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Took 15.51 seconds to spawn the instance on the hypervisor.
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181797.6029446, 6956e66e-229d-4f95-9d0b-d1e8c89a5360 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] VM Resumed (Lifecycle Event)
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Instance spawned successfully.
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Took 16.50 seconds to build instance.
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181797.6323235, 6956e66e-229d-4f95-9d0b-d1e8c89a5360 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] VM Started (Lifecycle Event)
Aug 16 10:29:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-be7e60d0-c386-4911-9449-79cf7ce5a6a0 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.682s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Took 14.47 seconds to spawn the instance on the hypervisor.
Aug 16 10:29:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:29:57 user nova-compute[73067]: INFO nova.compute.manager [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Took 15.56 seconds to build instance.
Aug 16 10:29:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0b5a2a17-41f9-4c52-b29a-1563e8d10f34 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.836s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG nova.compute.manager [req-61c0e912-0b7e-4f7f-a88d-7e21f5c0238d req-4330680a-7f6f-4a45-8aee-1a01634d0ea5 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Received event network-vif-plugged-0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-61c0e912-0b7e-4f7f-a88d-7e21f5c0238d req-4330680a-7f6f-4a45-8aee-1a01634d0ea5 service nova] Acquiring lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-61c0e912-0b7e-4f7f-a88d-7e21f5c0238d req-4330680a-7f6f-4a45-8aee-1a01634d0ea5 service nova] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-61c0e912-0b7e-4f7f-a88d-7e21f5c0238d req-4330680a-7f6f-4a45-8aee-1a01634d0ea5 service nova] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG nova.compute.manager [req-61c0e912-0b7e-4f7f-a88d-7e21f5c0238d req-4330680a-7f6f-4a45-8aee-1a01634d0ea5 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] No waiting events found dispatching network-vif-plugged-0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:29:59 user nova-compute[73067]: WARNING nova.compute.manager [req-61c0e912-0b7e-4f7f-a88d-7e21f5c0238d req-4330680a-7f6f-4a45-8aee-1a01634d0ea5 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Received unexpected event network-vif-plugged-0c460a72-6515-44f6-80d4-5a682c43a834 for instance with vm_state active and task_state None.
Aug 16 10:29:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:29:59 user nova-compute[73067]: INFO nova.compute.claims [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Claim successful on node user
Aug 16 10:29:59 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:29:59 user nova-compute[73067]: DEBUG nova.network.neutron [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:29:59 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 16 10:30:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-d6d8258d-09c0-4952-8da2-a21e57532b16 req-8cea94ab-4c3e-4b9a-a797-0d2af93ba6e8 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Received event network-vif-plugged-e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d6d8258d-09c0-4952-8da2-a21e57532b16 req-8cea94ab-4c3e-4b9a-a797-0d2af93ba6e8 service nova] Acquiring lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d6d8258d-09c0-4952-8da2-a21e57532b16 req-8cea94ab-4c3e-4b9a-a797-0d2af93ba6e8 service nova] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d6d8258d-09c0-4952-8da2-a21e57532b16 req-8cea94ab-4c3e-4b9a-a797-0d2af93ba6e8 service nova] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-d6d8258d-09c0-4952-8da2-a21e57532b16 req-8cea94ab-4c3e-4b9a-a797-0d2af93ba6e8 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] No waiting events found dispatching network-vif-plugged-e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:00 user nova-compute[73067]: WARNING nova.compute.manager [req-d6d8258d-09c0-4952-8da2-a21e57532b16 req-8cea94ab-4c3e-4b9a-a797-0d2af93ba6e8 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Received unexpected event network-vif-plugged-e67ff481-da2d-4922-9c80-dd085c42cc05 for instance with vm_state active and task_state None.
Aug 16 10:30:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG nova.policy [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99a6a3b874a84a01a4807da2fbab02e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4e2f19ebc042ddaaa3f7a410ccf10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:30:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Creating image(s)
Aug 16 10:30:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "/opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "/opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "423697174592b5a0a980509fe69c00eaba6176e7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "423697174592b5a0a980509fe69c00eaba6176e7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7.part --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7.part --force-share --output=json" returned: 0 in 0.248s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG nova.virt.images [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] 8385c313-eeac-44d4-94d9-1cb8be8dbdd9 was qcow2, converting to raw {{(pid=73067) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7.part /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7.converted {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7.part /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7.converted" returned: 0 in 0.473s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7.converted --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG nova.network.neutron [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Successfully created port: f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:01 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:30:01 user nova-compute[73067]: INFO nova.compute.claims [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Claim successful on node user
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7.converted --force-share --output=json" returned: 0 in 0.272s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "423697174592b5a0a980509fe69c00eaba6176e7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.531s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-d0a78c97-7eea-455a-88b0-26b33b2b25a0 req-4aa32e35-ef2e-49c7-aaae-934b4e815fde service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Received event network-vif-plugged-e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d0a78c97-7eea-455a-88b0-26b33b2b25a0 req-4aa32e35-ef2e-49c7-aaae-934b4e815fde service nova] Acquiring lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d0a78c97-7eea-455a-88b0-26b33b2b25a0 req-4aa32e35-ef2e-49c7-aaae-934b4e815fde service nova] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d0a78c97-7eea-455a-88b0-26b33b2b25a0 req-4aa32e35-ef2e-49c7-aaae-934b4e815fde service nova] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-d0a78c97-7eea-455a-88b0-26b33b2b25a0 req-4aa32e35-ef2e-49c7-aaae-934b4e815fde service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] No waiting events found dispatching network-vif-plugged-e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:02 user nova-compute[73067]: WARNING nova.compute.manager [req-d0a78c97-7eea-455a-88b0-26b33b2b25a0 req-4aa32e35-ef2e-49c7-aaae-934b4e815fde service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Received unexpected event network-vif-plugged-e67ff481-da2d-4922-9c80-dd085c42cc05 for instance with vm_state active and task_state None.
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7 --force-share --output=json" returned: 0 in 0.229s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "423697174592b5a0a980509fe69c00eaba6176e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "423697174592b5a0a980509fe69c00eaba6176e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7 --force-share --output=json" returned: 0 in 0.285s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7,backing_fmt=raw /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7,backing_fmt=raw /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk 1073741824" returned: 0 in 0.114s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "423697174592b5a0a980509fe69c00eaba6176e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.409s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.011s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7 --force-share --output=json" returned: 0 in 0.321s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Successfully updated port: f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:30:03 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.compute.manager [req-5796328e-429e-4243-ae93-bbd07df9df20 req-9a685b65-d9be-45d6-b9bb-6e2ac6076b85 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received event network-changed-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.compute.manager [req-5796328e-429e-4243-ae93-bbd07df9df20 req-9a685b65-d9be-45d6-b9bb-6e2ac6076b85 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Refreshing instance network info cache due to event network-changed-f62affe8-9713-4377-b35b-b43ca9d09bfe. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5796328e-429e-4243-ae93-bbd07df9df20 req-9a685b65-d9be-45d6-b9bb-6e2ac6076b85 service nova] Acquiring lock "refresh_cache-bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5796328e-429e-4243-ae93-bbd07df9df20 req-9a685b65-d9be-45d6-b9bb-6e2ac6076b85 service nova] Acquired lock "refresh_cache-bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.network.neutron [req-5796328e-429e-4243-ae93-bbd07df9df20 req-9a685b65-d9be-45d6-b9bb-6e2ac6076b85 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Refreshing network info cache for port f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "refresh_cache-bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk --force-share --output=json" returned: 0 in 0.359s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Cannot resize image /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.objects.instance [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lazy-loading 'migration_context' on Instance uuid bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.network.neutron [req-5796328e-429e-4243-ae93-bbd07df9df20 req-9a685b65-d9be-45d6-b9bb-6e2ac6076b85 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Ensure instance console log exists: /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:30:03 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Creating image(s)
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "/opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "/opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "/opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.policy [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b63f9ed0b5294eaf8919cf4c9bcea4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e7f124a2a74ac482ff13de710ba04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.286s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.network.neutron [req-5796328e-429e-4243-ae93-bbd07df9df20 req-9a685b65-d9be-45d6-b9bb-6e2ac6076b85 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5796328e-429e-4243-ae93-bbd07df9df20 req-9a685b65-d9be-45d6-b9bb-6e2ac6076b85 service nova] Releasing lock "refresh_cache-bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquired lock "refresh_cache-bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.network.neutron [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.245s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk 1073741824" returned: 0 in 0.077s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.254s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.network.neutron [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Updating instance_info_cache with network_info: [{"id": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "address": "fa:16:3e:df:ca:f4", "network": {"id": "b1a0d1c6-2561-40ab-9e22-0987023a848d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-173580811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea4e2f19ebc042ddaaa3f7a410ccf10b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62affe8-97", "ovs_interfaceid": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Releasing lock "refresh_cache-bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Instance network_info: |[{"id": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "address": "fa:16:3e:df:ca:f4", "network": {"id": "b1a0d1c6-2561-40ab-9e22-0987023a848d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-173580811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea4e2f19ebc042ddaaa3f7a410ccf10b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62affe8-97", "ovs_interfaceid": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Start _get_guest_xml network_info=[{"id": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "address": "fa:16:3e:df:ca:f4", "network": {"id": "b1a0d1c6-2561-40ab-9e22-0987023a848d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-173580811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea4e2f19ebc042ddaaa3f7a410ccf10b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62affe8-97", "ovs_interfaceid": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:29:50Z,direct_url=<?>,disk_format='qcow2',id=8385c313-eeac-44d4-94d9-1cb8be8dbdd9,min_disk=0,min_ram=0,name='',owner='a3eaa123677e4b80ac332b1e464760d3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:29:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'scsi', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'image_id': '8385c313-eeac-44d4-94d9-1cb8be8dbdd9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:30:04 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:04 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:29:50Z,direct_url=<?>,disk_format='qcow2',id=8385c313-eeac-44d4-94d9-1cb8be8dbdd9,min_disk=0,min_ram=0,name='',owner='a3eaa123677e4b80ac332b1e464760d3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:29:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1503187959',display_name='tempest-AttachSCSIVolumeTestJSON-server-1503187959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1503187959',id=5,image_ref='8385c313-eeac-44d4-94d9-1cb8be8dbdd9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS8CTjyXSCTsOUMjCfogohFecjhviSh/FyMA4HcK5FjYbT8azvVrWMAAxVHGaJcRPq5o/jl+CGjBkqLCio1LyISSvar6+Csxqh/dk1Sr0zuGjey6clICrvWaS8xWMCzVg==',key_name='tempest-keypair-877037551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea4e2f19ebc042ddaaa3f7a410ccf10b',ramdisk_id='',reservation_id='r-g91w9kq3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8385c313-eeac-44d4-94d9-1cb8be8dbdd9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1312893955',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1312893955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99a6a3b874a84a01a4807da2fbab02e6',uuid=bc2b0cc0-5227-4e0d-8823-3bc82bd30e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "address": "fa:16:3e:df:ca:f4", "network": {"id": "b1a0d1c6-2561-40ab-9e22-0987023a848d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-173580811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea4e2f19ebc042ddaaa3f7a410ccf10b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62affe8-97", "ovs_interfaceid": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Converting VIF {"id": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "address": "fa:16:3e:df:ca:f4", "network": {"id": "b1a0d1c6-2561-40ab-9e22-0987023a848d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-173580811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea4e2f19ebc042ddaaa3f7a410ccf10b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62affe8-97", "ovs_interfaceid": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ca:f4,bridge_name='br-int',has_traffic_filtering=True,id=f62affe8-9713-4377-b35b-b43ca9d09bfe,network=Network(b1a0d1c6-2561-40ab-9e22-0987023a848d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62affe8-97') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.objects.instance [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lazy-loading 'pci_devices' on Instance uuid bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:30:04 user nova-compute[73067]:   <uuid>bc2b0cc0-5227-4e0d-8823-3bc82bd30e22</uuid>
Aug 16 10:30:04 user nova-compute[73067]:   <name>instance-00000005</name>
Aug 16 10:30:04 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:30:04 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:30:04 user nova-compute[73067]:   <metadata>
Aug 16 10:30:04 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:30:04 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:30:04 user nova-compute[73067]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1503187959</nova:name>
Aug 16 10:30:04 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:30:04</nova:creationTime>
Aug 16 10:30:04 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:30:04 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:30:04 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:30:04 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:30:04 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:30:04 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:30:04 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:30:04 user nova-compute[73067]:       <nova:owner>
Aug 16 10:30:04 user nova-compute[73067]:         <nova:user uuid="99a6a3b874a84a01a4807da2fbab02e6">tempest-AttachSCSIVolumeTestJSON-1312893955-project-member</nova:user>
Aug 16 10:30:04 user nova-compute[73067]:         <nova:project uuid="ea4e2f19ebc042ddaaa3f7a410ccf10b">tempest-AttachSCSIVolumeTestJSON-1312893955</nova:project>
Aug 16 10:30:04 user nova-compute[73067]:       </nova:owner>
Aug 16 10:30:04 user nova-compute[73067]:       <nova:root type="image" uuid="8385c313-eeac-44d4-94d9-1cb8be8dbdd9"/>
Aug 16 10:30:04 user nova-compute[73067]:       <nova:ports>
Aug 16 10:30:04 user nova-compute[73067]:         <nova:port uuid="f62affe8-9713-4377-b35b-b43ca9d09bfe">
Aug 16 10:30:04 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 10:30:04 user nova-compute[73067]:         </nova:port>
Aug 16 10:30:04 user nova-compute[73067]:       </nova:ports>
Aug 16 10:30:04 user nova-compute[73067]:     </nova:instance>
Aug 16 10:30:04 user nova-compute[73067]:   </metadata>
Aug 16 10:30:04 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:30:04 user nova-compute[73067]:     <system>
Aug 16 10:30:04 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:30:04 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:30:04 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:30:04 user nova-compute[73067]:       <entry name="serial">bc2b0cc0-5227-4e0d-8823-3bc82bd30e22</entry>
Aug 16 10:30:04 user nova-compute[73067]:       <entry name="uuid">bc2b0cc0-5227-4e0d-8823-3bc82bd30e22</entry>
Aug 16 10:30:04 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:30:04 user nova-compute[73067]:     </system>
Aug 16 10:30:04 user nova-compute[73067]:   </sysinfo>
Aug 16 10:30:04 user nova-compute[73067]:   <os>
Aug 16 10:30:04 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:30:04 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:30:04 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:30:04 user nova-compute[73067]:   </os>
Aug 16 10:30:04 user nova-compute[73067]:   <features>
Aug 16 10:30:04 user nova-compute[73067]:     <acpi/>
Aug 16 10:30:04 user nova-compute[73067]:     <apic/>
Aug 16 10:30:04 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:30:04 user nova-compute[73067]:   </features>
Aug 16 10:30:04 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:30:04 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:30:04 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:30:04 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:30:04 user nova-compute[73067]:   </clock>
Aug 16 10:30:04 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:30:04 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:30:04 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:30:04 user nova-compute[73067]:   </cpu>
Aug 16 10:30:04 user nova-compute[73067]:   <devices>
Aug 16 10:30:04 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:30:04 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:30:04 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk"/>
Aug 16 10:30:04 user nova-compute[73067]:       <target dev="sda" bus="scsi"/>
Aug 16 10:30:04 user nova-compute[73067]:       <address type="drive" controller="0" unit="0"/>
Aug 16 10:30:04 user nova-compute[73067]:     </disk>
Aug 16 10:30:04 user nova-compute[73067]:     <disk type="file" device="cdrom">
Aug 16 10:30:04 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 10:30:04 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk.config"/>
Aug 16 10:30:04 user nova-compute[73067]:       <target dev="sdb" bus="scsi"/>
Aug 16 10:30:04 user nova-compute[73067]:       <address type="drive" controller="0" unit="1"/>
Aug 16 10:30:04 user nova-compute[73067]:     </disk>
Aug 16 10:30:04 user nova-compute[73067]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 16 10:30:04 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:30:04 user nova-compute[73067]:       <mac address="fa:16:3e:df:ca:f4"/>
Aug 16 10:30:04 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:30:04 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:30:04 user nova-compute[73067]:       <target dev="tapf62affe8-97"/>
Aug 16 10:30:04 user nova-compute[73067]:     </interface>
Aug 16 10:30:04 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:30:04 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/console.log" append="off"/>
Aug 16 10:30:04 user nova-compute[73067]:     </serial>
Aug 16 10:30:04 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:30:04 user nova-compute[73067]:     <video>
Aug 16 10:30:04 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:30:04 user nova-compute[73067]:     </video>
Aug 16 10:30:04 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:30:04 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:30:04 user nova-compute[73067]:     </rng>
Aug 16 10:30:04 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:30:04 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:30:04 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:30:04 user nova-compute[73067]:     </memballoon>
Aug 16 10:30:04 user nova-compute[73067]:   </devices>
Aug 16 10:30:04 user nova-compute[73067]: </domain>
Aug 16 10:30:04 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1503187959',display_name='tempest-AttachSCSIVolumeTestJSON-server-1503187959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1503187959',id=5,image_ref='8385c313-eeac-44d4-94d9-1cb8be8dbdd9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS8CTjyXSCTsOUMjCfogohFecjhviSh/FyMA4HcK5FjYbT8azvVrWMAAxVHGaJcRPq5o/jl+CGjBkqLCio1LyISSvar6+Csxqh/dk1Sr0zuGjey6clICrvWaS8xWMCzVg==',key_name='tempest-keypair-877037551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea4e2f19ebc042ddaaa3f7a410ccf10b',ramdisk_id='',reservation_id='r-g91w9kq3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8385c313-eeac-44d4-94d9-1cb8be8dbdd9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1312893955',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1312893955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99a6a3b874a84a01a4807da2fbab02e6',uuid=bc2b0cc0-5227-4e0d-8823-3bc82bd30e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "address": "fa:16:3e:df:ca:f4", "network": {"id": "b1a0d1c6-2561-40ab-9e22-0987023a848d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-173580811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea4e2f19ebc042ddaaa3f7a410ccf10b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62affe8-97", "ovs_interfaceid": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Converting VIF {"id": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "address": "fa:16:3e:df:ca:f4", "network": {"id": "b1a0d1c6-2561-40ab-9e22-0987023a848d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-173580811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea4e2f19ebc042ddaaa3f7a410ccf10b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62affe8-97", "ovs_interfaceid": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ca:f4,bridge_name='br-int',has_traffic_filtering=True,id=f62affe8-9713-4377-b35b-b43ca9d09bfe,network=Network(b1a0d1c6-2561-40ab-9e22-0987023a848d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62affe8-97') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG os_vif [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ca:f4,bridge_name='br-int',has_traffic_filtering=True,id=f62affe8-9713-4377-b35b-b43ca9d09bfe,network=Network(b1a0d1c6-2561-40ab-9e22-0987023a848d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62affe8-97') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf62affe8-97, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf62affe8-97, col_values=(('external_ids', {'iface-id': 'f62affe8-9713-4377-b35b-b43ca9d09bfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:ca:f4', 'vm-uuid': 'bc2b0cc0-5227-4e0d-8823-3bc82bd30e22'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Cannot resize image /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lazy-loading 'migration_context' on Instance uuid cca10fa3-1289-4ee9-b1d8-fe37afc92960 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:04 user nova-compute[73067]: INFO os_vif [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ca:f4,bridge_name='br-int',has_traffic_filtering=True,id=f62affe8-9713-4377-b35b-b43ca9d09bfe,network=Network(b1a0d1c6-2561-40ab-9e22-0987023a848d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62affe8-97')
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Ensure instance console log exists: /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] No BDM found with device name sda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:30:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] No VIF found with MAC fa:16:3e:df:ca:f4, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:30:04 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Using config drive
Aug 16 10:30:05 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Creating config drive at /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk.config
Aug 16 10:30:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2su4p1xe {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:05 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Successfully created port: 8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:30:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2su4p1xe" returned: 0 in 0.080s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Acquiring lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:07 user nova-compute[73067]: DEBUG nova.compute.manager [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:30:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:07 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:30:07 user nova-compute[73067]: INFO nova.compute.claims [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Claim successful on node user
Aug 16 10:30:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Successfully updated port: 8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquired lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-d2698f88-2314-41b6-8865-db20654def36 req-3628b7da-0ba2-4a1a-a72a-94fc5fede962 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received event network-changed-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-d2698f88-2314-41b6-8865-db20654def36 req-3628b7da-0ba2-4a1a-a72a-94fc5fede962 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Refreshing instance network info cache due to event network-changed-8775245b-73ca-43f0-b4cd-170134560df7. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d2698f88-2314-41b6-8865-db20654def36 req-3628b7da-0ba2-4a1a-a72a-94fc5fede962 service nova] Acquiring lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.network.neutron [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:30:08 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.policy [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c7ff62bc4a84ea393759c679ca46a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026fa602bff1432596eb8c422511b442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:30:08 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Creating image(s)
Aug 16 10:30:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "/opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "/opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Updating instance_info_cache with network_info: [{"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Releasing lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Instance network_info: |[{"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d2698f88-2314-41b6-8865-db20654def36 req-3628b7da-0ba2-4a1a-a72a-94fc5fede962 service nova] Acquired lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.network.neutron [req-d2698f88-2314-41b6-8865-db20654def36 req-3628b7da-0ba2-4a1a-a72a-94fc5fede962 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Refreshing network info cache for port 8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Start _get_guest_xml network_info=[{"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:30:08 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:08 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1314418798',display_name='tempest-VolumesAdminNegativeTest-server-1314418798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1314418798',id=6,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyKi2smPOie1HRX/p6hS/Y6z904llmKey53nToTLsDJw2pdpik02tH5DT3sMW4lAiitRvvEefM2Yd21+khylfepRTr4NVFRn4RSKhwnj+tx7FtX/RIEUqQ4SzJg/KVpNQ==',key_name='tempest-keypair-505197428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e7f124a2a74ac482ff13de710ba04a',ramdisk_id='',reservation_id='r-c0yvwpik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1324591370',owner_user_name='tempest-VolumesAdminNegativeTest-1324591370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b63f9ed0b5294eaf8919cf4c9bcea4ea',uuid=cca10fa3-1289-4ee9-b1d8-fe37afc92960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converting VIF {"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:58:8c,bridge_name='br-int',has_traffic_filtering=True,id=8775245b-73ca-43f0-b4cd-170134560df7,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8775245b-73') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:30:08 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lazy-loading 'pci_devices' on Instance uuid cca10fa3-1289-4ee9-b1d8-fe37afc92960 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:30:09 user nova-compute[73067]:   <uuid>cca10fa3-1289-4ee9-b1d8-fe37afc92960</uuid>
Aug 16 10:30:09 user nova-compute[73067]:   <name>instance-00000006</name>
Aug 16 10:30:09 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:30:09 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:30:09 user nova-compute[73067]:   <metadata>
Aug 16 10:30:09 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:30:09 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:30:09 user nova-compute[73067]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1314418798</nova:name>
Aug 16 10:30:09 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:30:08</nova:creationTime>
Aug 16 10:30:09 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:30:09 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:30:09 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:30:09 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:30:09 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:30:09 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:30:09 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:30:09 user nova-compute[73067]:       <nova:owner>
Aug 16 10:30:09 user nova-compute[73067]:         <nova:user uuid="b63f9ed0b5294eaf8919cf4c9bcea4ea">tempest-VolumesAdminNegativeTest-1324591370-project-member</nova:user>
Aug 16 10:30:09 user nova-compute[73067]:         <nova:project uuid="82e7f124a2a74ac482ff13de710ba04a">tempest-VolumesAdminNegativeTest-1324591370</nova:project>
Aug 16 10:30:09 user nova-compute[73067]:       </nova:owner>
Aug 16 10:30:09 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:30:09 user nova-compute[73067]:       <nova:ports>
Aug 16 10:30:09 user nova-compute[73067]:         <nova:port uuid="8775245b-73ca-43f0-b4cd-170134560df7">
Aug 16 10:30:09 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 10:30:09 user nova-compute[73067]:         </nova:port>
Aug 16 10:30:09 user nova-compute[73067]:       </nova:ports>
Aug 16 10:30:09 user nova-compute[73067]:     </nova:instance>
Aug 16 10:30:09 user nova-compute[73067]:   </metadata>
Aug 16 10:30:09 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:30:09 user nova-compute[73067]:     <system>
Aug 16 10:30:09 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:30:09 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:30:09 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:30:09 user nova-compute[73067]:       <entry name="serial">cca10fa3-1289-4ee9-b1d8-fe37afc92960</entry>
Aug 16 10:30:09 user nova-compute[73067]:       <entry name="uuid">cca10fa3-1289-4ee9-b1d8-fe37afc92960</entry>
Aug 16 10:30:09 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:30:09 user nova-compute[73067]:     </system>
Aug 16 10:30:09 user nova-compute[73067]:   </sysinfo>
Aug 16 10:30:09 user nova-compute[73067]:   <os>
Aug 16 10:30:09 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:30:09 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:30:09 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:30:09 user nova-compute[73067]:   </os>
Aug 16 10:30:09 user nova-compute[73067]:   <features>
Aug 16 10:30:09 user nova-compute[73067]:     <acpi/>
Aug 16 10:30:09 user nova-compute[73067]:     <apic/>
Aug 16 10:30:09 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:30:09 user nova-compute[73067]:   </features>
Aug 16 10:30:09 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:30:09 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:30:09 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:30:09 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:30:09 user nova-compute[73067]:   </clock>
Aug 16 10:30:09 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:30:09 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:30:09 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:30:09 user nova-compute[73067]:   </cpu>
Aug 16 10:30:09 user nova-compute[73067]:   <devices>
Aug 16 10:30:09 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:30:09 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:30:09 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk"/>
Aug 16 10:30:09 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:30:09 user nova-compute[73067]:     </disk>
Aug 16 10:30:09 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:30:09 user nova-compute[73067]:       <mac address="fa:16:3e:01:58:8c"/>
Aug 16 10:30:09 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:30:09 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:30:09 user nova-compute[73067]:       <target dev="tap8775245b-73"/>
Aug 16 10:30:09 user nova-compute[73067]:     </interface>
Aug 16 10:30:09 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:30:09 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/console.log" append="off"/>
Aug 16 10:30:09 user nova-compute[73067]:     </serial>
Aug 16 10:30:09 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:30:09 user nova-compute[73067]:     <video>
Aug 16 10:30:09 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:30:09 user nova-compute[73067]:     </video>
Aug 16 10:30:09 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:30:09 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:30:09 user nova-compute[73067]:     </rng>
Aug 16 10:30:09 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:30:09 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:30:09 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:30:09 user nova-compute[73067]:     </memballoon>
Aug 16 10:30:09 user nova-compute[73067]:   </devices>
Aug 16 10:30:09 user nova-compute[73067]: </domain>
Aug 16 10:30:09 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1314418798',display_name='tempest-VolumesAdminNegativeTest-server-1314418798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1314418798',id=6,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyKi2smPOie1HRX/p6hS/Y6z904llmKey53nToTLsDJw2pdpik02tH5DT3sMW4lAiitRvvEefM2Yd21+khylfepRTr4NVFRn4RSKhwnj+tx7FtX/RIEUqQ4SzJg/KVpNQ==',key_name='tempest-keypair-505197428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e7f124a2a74ac482ff13de710ba04a',ramdisk_id='',reservation_id='r-c0yvwpik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1324591370',owner_user_name='tempest-VolumesAdminNegativeTest-1324591370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b63f9ed0b5294eaf8919cf4c9bcea4ea',uuid=cca10fa3-1289-4ee9-b1d8-fe37afc92960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converting VIF {"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:58:8c,bridge_name='br-int',has_traffic_filtering=True,id=8775245b-73ca-43f0-b4cd-170134560df7,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8775245b-73') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG os_vif [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:58:8c,bridge_name='br-int',has_traffic_filtering=True,id=8775245b-73ca-43f0-b4cd-170134560df7,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8775245b-73') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8775245b-73, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8775245b-73, col_values=(('external_ids', {'iface-id': '8775245b-73ca-43f0-b4cd-170134560df7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:58:8c', 'vm-uuid': 'cca10fa3-1289-4ee9-b1d8-fe37afc92960'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.281s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:30:09 user nova-compute[73067]: INFO os_vif [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:58:8c,bridge_name='br-int',has_traffic_filtering=True,id=8775245b-73ca-43f0-b4cd-170134560df7,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8775245b-73')
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] No VIF found with MAC fa:16:3e:01:58:8c, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:30:09 user nova-compute[73067]: INFO nova.compute.claims [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Claim successful on node user
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.241s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk 1073741824" returned: 0 in 0.091s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.network.neutron [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Successfully created port: 32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.287s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181809.8217146, bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:30:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] VM Resumed (Lifecycle Event)
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Instance spawned successfully.
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.network.neutron [req-d2698f88-2314-41b6-8865-db20654def36 req-3628b7da-0ba2-4a1a-a72a-94fc5fede962 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Updated VIF entry in instance network info cache for port 8775245b-73ca-43f0-b4cd-170134560df7. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.network.neutron [req-d2698f88-2314-41b6-8865-db20654def36 req-3628b7da-0ba2-4a1a-a72a-94fc5fede962 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Updating instance_info_cache with network_info: [{"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181809.8221152, bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:30:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] VM Started (Lifecycle Event)
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d2698f88-2314-41b6-8865-db20654def36 req-3628b7da-0ba2-4a1a-a72a-94fc5fede962 service nova] Releasing lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Cannot resize image /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.objects.instance [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lazy-loading 'migration_context' on Instance uuid 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Ensure instance console log exists: /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:30:10 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:30:10 user nova-compute[73067]: INFO nova.compute.manager [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Took 9.51 seconds to spawn the instance on the hypervisor.
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.866s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:30:10 user nova-compute[73067]: INFO nova.compute.manager [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Took 11.10 seconds to build instance.
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-1e6efea3-5d25-48db-a740-614458ecb680 req-eb7aae57-6c8c-4e78-b1d4-911ae5ea354a service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received event network-vif-plugged-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e6efea3-5d25-48db-a740-614458ecb680 req-eb7aae57-6c8c-4e78-b1d4-911ae5ea354a service nova] Acquiring lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e6efea3-5d25-48db-a740-614458ecb680 req-eb7aae57-6c8c-4e78-b1d4-911ae5ea354a service nova] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e6efea3-5d25-48db-a740-614458ecb680 req-eb7aae57-6c8c-4e78-b1d4-911ae5ea354a service nova] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-1e6efea3-5d25-48db-a740-614458ecb680 req-eb7aae57-6c8c-4e78-b1d4-911ae5ea354a service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] No waiting events found dispatching network-vif-plugged-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:10 user nova-compute[73067]: WARNING nova.compute.manager [req-1e6efea3-5d25-48db-a740-614458ecb680 req-eb7aae57-6c8c-4e78-b1d4-911ae5ea354a service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received unexpected event network-vif-plugged-f62affe8-9713-4377-b35b-b43ca9d09bfe for instance with vm_state active and task_state None.
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-66964e08-1707-42a1-9094-6372e21d8a6a tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.334s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:10 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:30:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.policy [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77535d32f7044acb9972a0dea8b2d882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc4d3a3d3249259022dc9de8015725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:30:10 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Creating image(s)
Aug 16 10:30:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.253s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.282s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Successfully updated port: 32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk 1073741824" returned: 0 in 0.082s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Acquiring lock "refresh_cache-6b5d4dbc-c660-4b40-81cd-871dfcaa9130" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Acquired lock "refresh_cache-6b5d4dbc-c660-4b40-81cd-871dfcaa9130" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Cannot resize image /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG nova.objects.instance [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lazy-loading 'migration_context' on Instance uuid 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Ensure instance console log exists: /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Updating instance_info_cache with network_info: [{"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Releasing lock "refresh_cache-6b5d4dbc-c660-4b40-81cd-871dfcaa9130" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Instance network_info: |[{"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Start _get_guest_xml network_info=[{"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:30:12 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:12 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1110878826',display_name='tempest-VolumesAssistedSnapshotsTest-server-1110878826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1110878826',id=7,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgvttldZutgpZ6Dj5zEj2++7tPL1cgZ/s4PKaNzjPiJIvPuU4eeXwkUn0Z5t6gEWNkDeBDfC1knQqdn4uAgd+0hd1VblBC5EyhdJ8kLil2w804CQhs8bd2MduCTUMK8/w==',key_name='tempest-keypair-1802283716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fa602bff1432596eb8c422511b442',ramdisk_id='',reservation_id='r-0f5b4ma4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1791340926',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1791340926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c7ff62bc4a84ea393759c679ca46a2b',uuid=6b5d4dbc-c660-4b40-81cd-871dfcaa9130,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Converting VIF {"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:f8,bridge_name='br-int',has_traffic_filtering=True,id=32c89e72-0827-416a-b000-48ae3fcef088,network=Network(b41d4b89-80e7-46be-a87a-89b900fe0855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c89e72-08') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.objects.instance [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:30:12 user nova-compute[73067]:   <uuid>6b5d4dbc-c660-4b40-81cd-871dfcaa9130</uuid>
Aug 16 10:30:12 user nova-compute[73067]:   <name>instance-00000007</name>
Aug 16 10:30:12 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:30:12 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:30:12 user nova-compute[73067]:   <metadata>
Aug 16 10:30:12 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:30:12 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:30:12 user nova-compute[73067]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1110878826</nova:name>
Aug 16 10:30:12 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:30:12</nova:creationTime>
Aug 16 10:30:12 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:30:12 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:30:12 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:30:12 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:30:12 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:30:12 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:30:12 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:30:12 user nova-compute[73067]:       <nova:owner>
Aug 16 10:30:12 user nova-compute[73067]:         <nova:user uuid="4c7ff62bc4a84ea393759c679ca46a2b">tempest-VolumesAssistedSnapshotsTest-1791340926-project-member</nova:user>
Aug 16 10:30:12 user nova-compute[73067]:         <nova:project uuid="026fa602bff1432596eb8c422511b442">tempest-VolumesAssistedSnapshotsTest-1791340926</nova:project>
Aug 16 10:30:12 user nova-compute[73067]:       </nova:owner>
Aug 16 10:30:12 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:30:12 user nova-compute[73067]:       <nova:ports>
Aug 16 10:30:12 user nova-compute[73067]:         <nova:port uuid="32c89e72-0827-416a-b000-48ae3fcef088">
Aug 16 10:30:12 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 10:30:12 user nova-compute[73067]:         </nova:port>
Aug 16 10:30:12 user nova-compute[73067]:       </nova:ports>
Aug 16 10:30:12 user nova-compute[73067]:     </nova:instance>
Aug 16 10:30:12 user nova-compute[73067]:   </metadata>
Aug 16 10:30:12 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:30:12 user nova-compute[73067]:     <system>
Aug 16 10:30:12 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:30:12 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:30:12 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:30:12 user nova-compute[73067]:       <entry name="serial">6b5d4dbc-c660-4b40-81cd-871dfcaa9130</entry>
Aug 16 10:30:12 user nova-compute[73067]:       <entry name="uuid">6b5d4dbc-c660-4b40-81cd-871dfcaa9130</entry>
Aug 16 10:30:12 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:30:12 user nova-compute[73067]:     </system>
Aug 16 10:30:12 user nova-compute[73067]:   </sysinfo>
Aug 16 10:30:12 user nova-compute[73067]:   <os>
Aug 16 10:30:12 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:30:12 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:30:12 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:30:12 user nova-compute[73067]:   </os>
Aug 16 10:30:12 user nova-compute[73067]:   <features>
Aug 16 10:30:12 user nova-compute[73067]:     <acpi/>
Aug 16 10:30:12 user nova-compute[73067]:     <apic/>
Aug 16 10:30:12 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:30:12 user nova-compute[73067]:   </features>
Aug 16 10:30:12 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:30:12 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:30:12 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:30:12 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:30:12 user nova-compute[73067]:   </clock>
Aug 16 10:30:12 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:30:12 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:30:12 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:30:12 user nova-compute[73067]:   </cpu>
Aug 16 10:30:12 user nova-compute[73067]:   <devices>
Aug 16 10:30:12 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:30:12 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:30:12 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk"/>
Aug 16 10:30:12 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:30:12 user nova-compute[73067]:     </disk>
Aug 16 10:30:12 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:30:12 user nova-compute[73067]:       <mac address="fa:16:3e:5c:82:f8"/>
Aug 16 10:30:12 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:30:12 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:30:12 user nova-compute[73067]:       <target dev="tap32c89e72-08"/>
Aug 16 10:30:12 user nova-compute[73067]:     </interface>
Aug 16 10:30:12 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:30:12 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/console.log" append="off"/>
Aug 16 10:30:12 user nova-compute[73067]:     </serial>
Aug 16 10:30:12 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:30:12 user nova-compute[73067]:     <video>
Aug 16 10:30:12 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:30:12 user nova-compute[73067]:     </video>
Aug 16 10:30:12 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:30:12 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:30:12 user nova-compute[73067]:     </rng>
Aug 16 10:30:12 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:30:12 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:30:12 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:30:12 user nova-compute[73067]:     </memballoon>
Aug 16 10:30:12 user nova-compute[73067]:   </devices>
Aug 16 10:30:12 user nova-compute[73067]: </domain>
Aug 16 10:30:12 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1110878826',display_name='tempest-VolumesAssistedSnapshotsTest-server-1110878826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1110878826',id=7,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgvttldZutgpZ6Dj5zEj2++7tPL1cgZ/s4PKaNzjPiJIvPuU4eeXwkUn0Z5t6gEWNkDeBDfC1knQqdn4uAgd+0hd1VblBC5EyhdJ8kLil2w804CQhs8bd2MduCTUMK8/w==',key_name='tempest-keypair-1802283716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fa602bff1432596eb8c422511b442',ramdisk_id='',reservation_id='r-0f5b4ma4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1791340926',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1791340926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c7ff62bc4a84ea393759c679ca46a2b',uuid=6b5d4dbc-c660-4b40-81cd-871dfcaa9130,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Converting VIF {"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:f8,bridge_name='br-int',has_traffic_filtering=True,id=32c89e72-0827-416a-b000-48ae3fcef088,network=Network(b41d4b89-80e7-46be-a87a-89b900fe0855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c89e72-08') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG os_vif [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:f8,bridge_name='br-int',has_traffic_filtering=True,id=32c89e72-0827-416a-b000-48ae3fcef088,network=Network(b41d4b89-80e7-46be-a87a-89b900fe0855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c89e72-08') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c89e72-08, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32c89e72-08, col_values=(('external_ids', {'iface-id': '32c89e72-0827-416a-b000-48ae3fcef088', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:82:f8', 'vm-uuid': '6b5d4dbc-c660-4b40-81cd-871dfcaa9130'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:12 user nova-compute[73067]: INFO os_vif [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:f8,bridge_name='br-int',has_traffic_filtering=True,id=32c89e72-0827-416a-b000-48ae3fcef088,network=Network(b41d4b89-80e7-46be-a87a-89b900fe0855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c89e72-08')
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Successfully created port: 185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] No VIF found with MAC fa:16:3e:5c:82:f8, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.compute.manager [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received event network-vif-plugged-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] Acquiring lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.compute.manager [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] No waiting events found dispatching network-vif-plugged-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:12 user nova-compute[73067]: WARNING nova.compute.manager [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received unexpected event network-vif-plugged-f62affe8-9713-4377-b35b-b43ca9d09bfe for instance with vm_state active and task_state None.
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.compute.manager [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received event network-changed-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.compute.manager [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Refreshing instance network info cache due to event network-changed-32c89e72-0827-416a-b000-48ae3fcef088. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] Acquiring lock "refresh_cache-6b5d4dbc-c660-4b40-81cd-871dfcaa9130" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] Acquired lock "refresh_cache-6b5d4dbc-c660-4b40-81cd-871dfcaa9130" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:12 user nova-compute[73067]: DEBUG nova.network.neutron [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Refreshing network info cache for port 32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:30:13 user nova-compute[73067]: DEBUG nova.network.neutron [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Updated VIF entry in instance network info cache for port 32c89e72-0827-416a-b000-48ae3fcef088. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:30:13 user nova-compute[73067]: DEBUG nova.network.neutron [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Updating instance_info_cache with network_info: [{"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6ae85826-5478-472b-9380-b260e1fe7ed0 req-c804da0d-055b-4df0-8e42-45311386f06c service nova] Releasing lock "refresh_cache-6b5d4dbc-c660-4b40-81cd-871dfcaa9130" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.compute.manager [req-c97fab5b-4296-4670-804a-6d33eda595ea req-b0a528af-319f-468c-8a49-8c9099230263 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c97fab5b-4296-4670-804a-6d33eda595ea req-b0a528af-319f-468c-8a49-8c9099230263 service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c97fab5b-4296-4670-804a-6d33eda595ea req-b0a528af-319f-468c-8a49-8c9099230263 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c97fab5b-4296-4670-804a-6d33eda595ea req-b0a528af-319f-468c-8a49-8c9099230263 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.compute.manager [req-c97fab5b-4296-4670-804a-6d33eda595ea req-b0a528af-319f-468c-8a49-8c9099230263 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:14 user nova-compute[73067]: WARNING nova.compute.manager [req-c97fab5b-4296-4670-804a-6d33eda595ea req-b0a528af-319f-468c-8a49-8c9099230263 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state active and task_state None.
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181814.1084983, cca10fa3-1289-4ee9-b1d8-fe37afc92960 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:30:14 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] VM Resumed (Lifecycle Event)
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:14 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Instance spawned successfully.
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:14 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181814.1321735, cca10fa3-1289-4ee9-b1d8-fe37afc92960 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:30:14 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] VM Started (Lifecycle Event)
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.compute.manager [req-c3665d08-7703-4486-abd4-f93b75c87963 req-fa1282b6-8683-44e4-93d2-ce7196449c5b service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received event network-vif-plugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3665d08-7703-4486-abd4-f93b75c87963 req-fa1282b6-8683-44e4-93d2-ce7196449c5b service nova] Acquiring lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3665d08-7703-4486-abd4-f93b75c87963 req-fa1282b6-8683-44e4-93d2-ce7196449c5b service nova] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3665d08-7703-4486-abd4-f93b75c87963 req-fa1282b6-8683-44e4-93d2-ce7196449c5b service nova] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.compute.manager [req-c3665d08-7703-4486-abd4-f93b75c87963 req-fa1282b6-8683-44e4-93d2-ce7196449c5b service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] No waiting events found dispatching network-vif-plugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:14 user nova-compute[73067]: WARNING nova.compute.manager [req-c3665d08-7703-4486-abd4-f93b75c87963 req-fa1282b6-8683-44e4-93d2-ce7196449c5b service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received unexpected event network-vif-plugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d for instance with vm_state active and task_state None.
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:30:14 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:30:14 user nova-compute[73067]: INFO nova.compute.manager [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Took 10.83 seconds to spawn the instance on the hypervisor.
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:14 user nova-compute[73067]: INFO nova.compute.manager [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Took 12.66 seconds to build instance.
Aug 16 10:30:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f2da7942-de30-49e7-b578-ab82d2913da0 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.138s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Successfully updated port: 185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquired lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:30:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updating instance_info_cache with network_info: [{"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Releasing lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Instance network_info: |[{"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Start _get_guest_xml network_info=[{"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:30:15 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:15 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-549440583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-549440583',id=8,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/ET4f+GadAJ2XEk1G0bW3MJhSK9fZRqno/3i6IGeLmLpNdtSstzLjv1zvrKcBm/cTzruDBnMijgSTFRsgfXO1gSW064pzF0QTVeNoDA8Zd2epUz5KDmPX2yAUQRp8fNw==',key_name='tempest-keypair-1652680034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78fc4d3a3d3249259022dc9de8015725',ramdisk_id='',reservation_id='r-sc8f08j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-632372241',owner_user_name='tempest-TaggedAttachmentsTest-632372241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77535d32f7044acb9972a0dea8b2d882',uuid=65299891-9731-4b3b-b23e-85813d45eb58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converting VIF {"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:c9:de,bridge_name='br-int',has_traffic_filtering=True,id=185f299d-2471-4692-9ead-a478e312f02e,network=Network(59243067-6bb6-426b-8fc9-e2eed1a2808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185f299d-24') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.objects.instance [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lazy-loading 'pci_devices' on Instance uuid 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:30:15 user nova-compute[73067]:   <uuid>65299891-9731-4b3b-b23e-85813d45eb58</uuid>
Aug 16 10:30:15 user nova-compute[73067]:   <name>instance-00000008</name>
Aug 16 10:30:15 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:30:15 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:30:15 user nova-compute[73067]:   <metadata>
Aug 16 10:30:15 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:30:15 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:30:15 user nova-compute[73067]:       <nova:name>tempest-device-tagging-server-549440583</nova:name>
Aug 16 10:30:15 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:30:15</nova:creationTime>
Aug 16 10:30:15 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:30:15 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:30:15 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:30:15 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:30:15 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:30:15 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:30:15 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:30:15 user nova-compute[73067]:       <nova:owner>
Aug 16 10:30:15 user nova-compute[73067]:         <nova:user uuid="77535d32f7044acb9972a0dea8b2d882">tempest-TaggedAttachmentsTest-632372241-project-member</nova:user>
Aug 16 10:30:15 user nova-compute[73067]:         <nova:project uuid="78fc4d3a3d3249259022dc9de8015725">tempest-TaggedAttachmentsTest-632372241</nova:project>
Aug 16 10:30:15 user nova-compute[73067]:       </nova:owner>
Aug 16 10:30:15 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:30:15 user nova-compute[73067]:       <nova:ports>
Aug 16 10:30:15 user nova-compute[73067]:         <nova:port uuid="185f299d-2471-4692-9ead-a478e312f02e">
Aug 16 10:30:15 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 10:30:15 user nova-compute[73067]:         </nova:port>
Aug 16 10:30:15 user nova-compute[73067]:       </nova:ports>
Aug 16 10:30:15 user nova-compute[73067]:     </nova:instance>
Aug 16 10:30:15 user nova-compute[73067]:   </metadata>
Aug 16 10:30:15 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:30:15 user nova-compute[73067]:     <system>
Aug 16 10:30:15 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:30:15 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:30:15 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:30:15 user nova-compute[73067]:       <entry name="serial">65299891-9731-4b3b-b23e-85813d45eb58</entry>
Aug 16 10:30:15 user nova-compute[73067]:       <entry name="uuid">65299891-9731-4b3b-b23e-85813d45eb58</entry>
Aug 16 10:30:15 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:30:15 user nova-compute[73067]:     </system>
Aug 16 10:30:15 user nova-compute[73067]:   </sysinfo>
Aug 16 10:30:15 user nova-compute[73067]:   <os>
Aug 16 10:30:15 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:30:15 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:30:15 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:30:15 user nova-compute[73067]:   </os>
Aug 16 10:30:15 user nova-compute[73067]:   <features>
Aug 16 10:30:15 user nova-compute[73067]:     <acpi/>
Aug 16 10:30:15 user nova-compute[73067]:     <apic/>
Aug 16 10:30:15 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:30:15 user nova-compute[73067]:   </features>
Aug 16 10:30:15 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:30:15 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:30:15 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:30:15 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:30:15 user nova-compute[73067]:   </clock>
Aug 16 10:30:15 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:30:15 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:30:15 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:30:15 user nova-compute[73067]:   </cpu>
Aug 16 10:30:15 user nova-compute[73067]:   <devices>
Aug 16 10:30:15 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:30:15 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:30:15 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk"/>
Aug 16 10:30:15 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:30:15 user nova-compute[73067]:     </disk>
Aug 16 10:30:15 user nova-compute[73067]:     <disk type="file" device="cdrom">
Aug 16 10:30:15 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 10:30:15 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk.config"/>
Aug 16 10:30:15 user nova-compute[73067]:       <target dev="hda" bus="ide"/>
Aug 16 10:30:15 user nova-compute[73067]:     </disk>
Aug 16 10:30:15 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:30:15 user nova-compute[73067]:       <mac address="fa:16:3e:62:c9:de"/>
Aug 16 10:30:15 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:30:15 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:30:15 user nova-compute[73067]:       <target dev="tap185f299d-24"/>
Aug 16 10:30:15 user nova-compute[73067]:     </interface>
Aug 16 10:30:15 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:30:15 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/console.log" append="off"/>
Aug 16 10:30:15 user nova-compute[73067]:     </serial>
Aug 16 10:30:15 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:30:15 user nova-compute[73067]:     <video>
Aug 16 10:30:15 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:30:15 user nova-compute[73067]:     </video>
Aug 16 10:30:15 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:30:15 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:30:15 user nova-compute[73067]:     </rng>
Aug 16 10:30:15 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:30:15 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:30:15 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:30:15 user nova-compute[73067]:     </memballoon>
Aug 16 10:30:15 user nova-compute[73067]:   </devices>
Aug 16 10:30:15 user nova-compute[73067]: </domain>
Aug 16 10:30:15 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-549440583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-549440583',id=8,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/ET4f+GadAJ2XEk1G0bW3MJhSK9fZRqno/3i6IGeLmLpNdtSstzLjv1zvrKcBm/cTzruDBnMijgSTFRsgfXO1gSW064pzF0QTVeNoDA8Zd2epUz5KDmPX2yAUQRp8fNw==',key_name='tempest-keypair-1652680034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78fc4d3a3d3249259022dc9de8015725',ramdisk_id='',reservation_id='r-sc8f08j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-632372241',owner_user_name='tempest-TaggedAttachmentsTest-632372241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77535d32f7044acb9972a0dea8b2d882',uuid=65299891-9731-4b3b-b23e-85813d45eb58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converting VIF {"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:c9:de,bridge_name='br-int',has_traffic_filtering=True,id=185f299d-2471-4692-9ead-a478e312f02e,network=Network(59243067-6bb6-426b-8fc9-e2eed1a2808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185f299d-24') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG os_vif [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:c9:de,bridge_name='br-int',has_traffic_filtering=True,id=185f299d-2471-4692-9ead-a478e312f02e,network=Network(59243067-6bb6-426b-8fc9-e2eed1a2808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185f299d-24') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap185f299d-24, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap185f299d-24, col_values=(('external_ids', {'iface-id': '185f299d-2471-4692-9ead-a478e312f02e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:c9:de', 'vm-uuid': '65299891-9731-4b3b-b23e-85813d45eb58'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:30:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:15 user nova-compute[73067]: INFO os_vif [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:c9:de,bridge_name='br-int',has_traffic_filtering=True,id=185f299d-2471-4692-9ead-a478e312f02e,network=Network(59243067-6bb6-426b-8fc9-e2eed1a2808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185f299d-24')
Aug 16 10:30:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] No BDM found with device name hda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] No VIF found with MAC fa:16:3e:62:c9:de, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:30:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Using config drive
Aug 16 10:30:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:16 user nova-compute[73067]: WARNING nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state active and task_state None.
Aug 16 10:30:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-changed-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Refreshing instance network info cache due to event network-changed-185f299d-2471-4692-9ead-a478e312f02e. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Acquiring lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Acquired lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG nova.network.neutron [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Refreshing network info cache for port 185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-869473da-c472-4818-8e2c-67510e3ea3ed req-98638ad5-121f-4bd9-bc8f-7fd32918eefc service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received event network-vif-plugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-869473da-c472-4818-8e2c-67510e3ea3ed req-98638ad5-121f-4bd9-bc8f-7fd32918eefc service nova] Acquiring lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-869473da-c472-4818-8e2c-67510e3ea3ed req-98638ad5-121f-4bd9-bc8f-7fd32918eefc service nova] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-869473da-c472-4818-8e2c-67510e3ea3ed req-98638ad5-121f-4bd9-bc8f-7fd32918eefc service nova] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-869473da-c472-4818-8e2c-67510e3ea3ed req-98638ad5-121f-4bd9-bc8f-7fd32918eefc service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] No waiting events found dispatching network-vif-plugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:16 user nova-compute[73067]: WARNING nova.compute.manager [req-869473da-c472-4818-8e2c-67510e3ea3ed req-98638ad5-121f-4bd9-bc8f-7fd32918eefc service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received unexpected event network-vif-plugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d for instance with vm_state active and task_state None.
Aug 16 10:30:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Creating config drive at /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk.config
Aug 16 10:30:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeteaf5bp {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeteaf5bp" returned: 0 in 0.073s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:17 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181817.7306662, 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:30:17 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] VM Resumed (Lifecycle Event)
Aug 16 10:30:17 user nova-compute[73067]: DEBUG nova.compute.manager [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:30:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:18 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Instance spawned successfully.
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updated VIF entry in instance network info cache for port 185f299d-2471-4692-9ead-a478e312f02e. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updating instance_info_cache with network_info: [{"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Releasing lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received event network-vif-plugged-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] No waiting events found dispatching network-vif-plugged-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:18 user nova-compute[73067]: WARNING nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received unexpected event network-vif-plugged-8775245b-73ca-43f0-b4cd-170134560df7 for instance with vm_state active and task_state None.
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received event network-vif-plugged-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] No waiting events found dispatching network-vif-plugged-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:18 user nova-compute[73067]: WARNING nova.compute.manager [req-b7c3325d-d1e3-4afc-b0cb-856dff43ebc6 req-027ce447-d39e-474f-a140-abe2c13e4417 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received unexpected event network-vif-plugged-8775245b-73ca-43f0-b4cd-170134560df7 for instance with vm_state active and task_state None.
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:18 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181817.7308567, 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:30:18 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] VM Started (Lifecycle Event)
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received event network-vif-plugged-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] Acquiring lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] No waiting events found dispatching network-vif-plugged-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:18 user nova-compute[73067]: WARNING nova.compute.manager [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received unexpected event network-vif-plugged-32c89e72-0827-416a-b000-48ae3fcef088 for instance with vm_state building and task_state spawning.
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received event network-vif-plugged-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] Acquiring lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] No waiting events found dispatching network-vif-plugged-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:18 user nova-compute[73067]: WARNING nova.compute.manager [req-947f8aa7-1c71-4ff9-b7d9-1ea20adb9703 req-7186601b-71a5-4746-8f6b-23900d9afc52 service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received unexpected event network-vif-plugged-32c89e72-0827-416a-b000-48ae3fcef088 for instance with vm_state building and task_state spawning.
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:30:18 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:30:18 user nova-compute[73067]: INFO nova.compute.manager [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Took 9.75 seconds to spawn the instance on the hypervisor.
Aug 16 10:30:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:18 user nova-compute[73067]: INFO nova.compute.manager [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Took 11.44 seconds to build instance.
Aug 16 10:30:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-65f0cca8-add0-4b7f-8193-4139d957d9ec tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.625s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] No waiting events found dispatching network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:20 user nova-compute[73067]: WARNING nova.compute.manager [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received unexpected event network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e for instance with vm_state building and task_state spawning.
Aug 16 10:30:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] No waiting events found dispatching network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:20 user nova-compute[73067]: WARNING nova.compute.manager [req-63f2c953-ea27-43e4-93c1-f0c0eadc2adf req-dd698894-7449-40f7-9d2d-08234c88b81b service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received unexpected event network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e for instance with vm_state building and task_state spawning.
Aug 16 10:30:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181821.5801563, 65299891-9731-4b3b-b23e-85813d45eb58 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:30:21 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] VM Resumed (Lifecycle Event)
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:30:21 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Instance spawned successfully.
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:21 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181821.5874743, 65299891-9731-4b3b-b23e-85813d45eb58 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:30:21 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] VM Started (Lifecycle Event)
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:30:21 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:30:21 user nova-compute[73067]: INFO nova.compute.manager [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Took 11.04 seconds to spawn the instance on the hypervisor.
Aug 16 10:30:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:21 user nova-compute[73067]: INFO nova.compute.manager [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Took 12.72 seconds to build instance.
Aug 16 10:30:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1337b546-2e89-4aed-b021-c1f69aeff84c tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.934s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 10:30:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 10:30:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 10:30:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:29 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:29 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7585MB free_disk=25.760643005371094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b51879a0-d5a1-4f96-b0c1-0672d31e80db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 65299891-9731-4b3b-b23e-85813d45eb58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f765ae8f-01ae-4eaf-a1ec-daaba1c72be1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:30:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.419s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:30:30 user nova-compute[73067]: INFO nova.compute.claims [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Claim successful on node user
Aug 16 10:30:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:30:30 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:30 user nova-compute[73067]: DEBUG nova.policy [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '586e0de6f261403fa757b2da4b578f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170bcb24cdf44e63ad5f42259b9c470c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:30:31 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Creating image(s)
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "/opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "/opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "/opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.206s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk 1073741824" returned: 0 in 0.049s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Successfully created port: 108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.213s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Cannot resize image /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lazy-loading 'migration_context' on Instance uuid f765ae8f-01ae-4eaf-a1ec-daaba1c72be1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Ensure instance console log exists: /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Skipping network cache update for instance because it is Building. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Successfully updated port: 108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "refresh_cache-f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquired lock "refresh_cache-f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-a5b0bf79-fdbb-42d3-b119-3183259c7f42 req-69d3dbb8-a933-45d4-91b8-490a1266e70a service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Received event network-changed-108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-a5b0bf79-fdbb-42d3-b119-3183259c7f42 req-69d3dbb8-a933-45d4-91b8-490a1266e70a service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Refreshing instance network info cache due to event network-changed-108872ff-3398-4aaf-b9e4-4a190e6c0975. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:30:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5b0bf79-fdbb-42d3-b119-3183259c7f42 req-69d3dbb8-a933-45d4-91b8-490a1266e70a service nova] Acquiring lock "refresh_cache-f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Updating instance_info_cache with network_info: [{"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Updating instance_info_cache with network_info: [{"id": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "address": "fa:16:3e:78:69:68", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108872ff-33", "ovs_interfaceid": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Releasing lock "refresh_cache-f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Instance network_info: |[{"id": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "address": "fa:16:3e:78:69:68", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108872ff-33", "ovs_interfaceid": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5b0bf79-fdbb-42d3-b119-3183259c7f42 req-69d3dbb8-a933-45d4-91b8-490a1266e70a service nova] Acquired lock "refresh_cache-f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-a5b0bf79-fdbb-42d3-b119-3183259c7f42 req-69d3dbb8-a933-45d4-91b8-490a1266e70a service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Refreshing network info cache for port 108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Start _get_guest_xml network_info=[{"id": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "address": "fa:16:3e:78:69:68", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108872ff-33", "ovs_interfaceid": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:30:33 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:33 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1540128314',display_name='tempest-VolumesActionsTest-instance-1540128314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1540128314',id=9,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='170bcb24cdf44e63ad5f42259b9c470c',ramdisk_id='',reservation_id='r-g2xyd90l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-811248869',owner_user_name='tempest-VolumesActionsTest-811248869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:31Z,user_data=None,user_id='586e0de6f261403fa757b2da4b578f8b',uuid=f765ae8f-01ae-4eaf-a1ec-daaba1c72be1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "address": "fa:16:3e:78:69:68", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108872ff-33", "ovs_interfaceid": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converting VIF {"id": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "address": "fa:16:3e:78:69:68", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108872ff-33", "ovs_interfaceid": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:68,bridge_name='br-int',has_traffic_filtering=True,id=108872ff-3398-4aaf-b9e4-4a190e6c0975,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108872ff-33') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lazy-loading 'pci_devices' on Instance uuid f765ae8f-01ae-4eaf-a1ec-daaba1c72be1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:30:33 user nova-compute[73067]:   <uuid>f765ae8f-01ae-4eaf-a1ec-daaba1c72be1</uuid>
Aug 16 10:30:33 user nova-compute[73067]:   <name>instance-00000009</name>
Aug 16 10:30:33 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:30:33 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:30:33 user nova-compute[73067]:   <metadata>
Aug 16 10:30:33 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:30:33 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:30:33 user nova-compute[73067]:       <nova:name>tempest-VolumesActionsTest-instance-1540128314</nova:name>
Aug 16 10:30:33 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:30:33</nova:creationTime>
Aug 16 10:30:33 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:30:33 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:30:33 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:30:33 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:30:33 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:30:33 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:30:33 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:30:33 user nova-compute[73067]:       <nova:owner>
Aug 16 10:30:33 user nova-compute[73067]:         <nova:user uuid="586e0de6f261403fa757b2da4b578f8b">tempest-VolumesActionsTest-811248869-project-member</nova:user>
Aug 16 10:30:33 user nova-compute[73067]:         <nova:project uuid="170bcb24cdf44e63ad5f42259b9c470c">tempest-VolumesActionsTest-811248869</nova:project>
Aug 16 10:30:33 user nova-compute[73067]:       </nova:owner>
Aug 16 10:30:33 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:30:33 user nova-compute[73067]:       <nova:ports>
Aug 16 10:30:33 user nova-compute[73067]:         <nova:port uuid="108872ff-3398-4aaf-b9e4-4a190e6c0975">
Aug 16 10:30:33 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 10:30:33 user nova-compute[73067]:         </nova:port>
Aug 16 10:30:33 user nova-compute[73067]:       </nova:ports>
Aug 16 10:30:33 user nova-compute[73067]:     </nova:instance>
Aug 16 10:30:33 user nova-compute[73067]:   </metadata>
Aug 16 10:30:33 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:30:33 user nova-compute[73067]:     <system>
Aug 16 10:30:33 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:30:33 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:30:33 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:30:33 user nova-compute[73067]:       <entry name="serial">f765ae8f-01ae-4eaf-a1ec-daaba1c72be1</entry>
Aug 16 10:30:33 user nova-compute[73067]:       <entry name="uuid">f765ae8f-01ae-4eaf-a1ec-daaba1c72be1</entry>
Aug 16 10:30:33 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:30:33 user nova-compute[73067]:     </system>
Aug 16 10:30:33 user nova-compute[73067]:   </sysinfo>
Aug 16 10:30:33 user nova-compute[73067]:   <os>
Aug 16 10:30:33 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:30:33 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:30:33 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:30:33 user nova-compute[73067]:   </os>
Aug 16 10:30:33 user nova-compute[73067]:   <features>
Aug 16 10:30:33 user nova-compute[73067]:     <acpi/>
Aug 16 10:30:33 user nova-compute[73067]:     <apic/>
Aug 16 10:30:33 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:30:33 user nova-compute[73067]:   </features>
Aug 16 10:30:33 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:30:33 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:30:33 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:30:33 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:30:33 user nova-compute[73067]:   </clock>
Aug 16 10:30:33 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:30:33 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:30:33 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:30:33 user nova-compute[73067]:   </cpu>
Aug 16 10:30:33 user nova-compute[73067]:   <devices>
Aug 16 10:30:33 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:30:33 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:30:33 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk"/>
Aug 16 10:30:33 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:30:33 user nova-compute[73067]:     </disk>
Aug 16 10:30:33 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:30:33 user nova-compute[73067]:       <mac address="fa:16:3e:78:69:68"/>
Aug 16 10:30:33 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:30:33 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:30:33 user nova-compute[73067]:       <target dev="tap108872ff-33"/>
Aug 16 10:30:33 user nova-compute[73067]:     </interface>
Aug 16 10:30:33 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:30:33 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/console.log" append="off"/>
Aug 16 10:30:33 user nova-compute[73067]:     </serial>
Aug 16 10:30:33 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:30:33 user nova-compute[73067]:     <video>
Aug 16 10:30:33 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:30:33 user nova-compute[73067]:     </video>
Aug 16 10:30:33 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:30:33 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:30:33 user nova-compute[73067]:     </rng>
Aug 16 10:30:33 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:30:33 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:30:33 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:30:33 user nova-compute[73067]:     </memballoon>
Aug 16 10:30:33 user nova-compute[73067]:   </devices>
Aug 16 10:30:33 user nova-compute[73067]: </domain>
Aug 16 10:30:33 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1540128314',display_name='tempest-VolumesActionsTest-instance-1540128314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1540128314',id=9,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='170bcb24cdf44e63ad5f42259b9c470c',ramdisk_id='',reservation_id='r-g2xyd90l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-811248869',owner_user_name='tempest-VolumesActionsTest-811248869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:31Z,user_data=None,user_id='586e0de6f261403fa757b2da4b578f8b',uuid=f765ae8f-01ae-4eaf-a1ec-daaba1c72be1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "address": "fa:16:3e:78:69:68", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108872ff-33", "ovs_interfaceid": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converting VIF {"id": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "address": "fa:16:3e:78:69:68", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108872ff-33", "ovs_interfaceid": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:68,bridge_name='br-int',has_traffic_filtering=True,id=108872ff-3398-4aaf-b9e4-4a190e6c0975,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108872ff-33') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG os_vif [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:68,bridge_name='br-int',has_traffic_filtering=True,id=108872ff-3398-4aaf-b9e4-4a190e6c0975,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108872ff-33') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap108872ff-33, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap108872ff-33, col_values=(('external_ids', {'iface-id': '108872ff-3398-4aaf-b9e4-4a190e6c0975', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:69:68', 'vm-uuid': 'f765ae8f-01ae-4eaf-a1ec-daaba1c72be1'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:33 user nova-compute[73067]: INFO os_vif [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:68,bridge_name='br-int',has_traffic_filtering=True,id=108872ff-3398-4aaf-b9e4-4a190e6c0975,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108872ff-33')
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] No VIF found with MAC fa:16:3e:78:69:68, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-a5b0bf79-fdbb-42d3-b119-3183259c7f42 req-69d3dbb8-a933-45d4-91b8-490a1266e70a service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Updated VIF entry in instance network info cache for port 108872ff-3398-4aaf-b9e4-4a190e6c0975. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-a5b0bf79-fdbb-42d3-b119-3183259c7f42 req-69d3dbb8-a933-45d4-91b8-490a1266e70a service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Updating instance_info_cache with network_info: [{"id": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "address": "fa:16:3e:78:69:68", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108872ff-33", "ovs_interfaceid": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:30:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5b0bf79-fdbb-42d3-b119-3183259c7f42 req-69d3dbb8-a933-45d4-91b8-490a1266e70a service nova] Releasing lock "refresh_cache-f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:30:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-71f64fde-4622-4c4b-8cf4-a80ffdb7e49f req-6adfec55-cbab-433a-be44-bb60412da5f6 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Received event network-vif-plugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-71f64fde-4622-4c4b-8cf4-a80ffdb7e49f req-6adfec55-cbab-433a-be44-bb60412da5f6 service nova] Acquiring lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-71f64fde-4622-4c4b-8cf4-a80ffdb7e49f req-6adfec55-cbab-433a-be44-bb60412da5f6 service nova] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-71f64fde-4622-4c4b-8cf4-a80ffdb7e49f req-6adfec55-cbab-433a-be44-bb60412da5f6 service nova] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-71f64fde-4622-4c4b-8cf4-a80ffdb7e49f req-6adfec55-cbab-433a-be44-bb60412da5f6 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] No waiting events found dispatching network-vif-plugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:35 user nova-compute[73067]: WARNING nova.compute.manager [req-71f64fde-4622-4c4b-8cf4-a80ffdb7e49f req-6adfec55-cbab-433a-be44-bb60412da5f6 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Received unexpected event network-vif-plugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 for instance with vm_state building and task_state spawning.
Aug 16 10:30:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-74c95505-6ea0-41d2-ba5e-fe6e7f7fd835 req-2575925d-8852-43ce-a87c-27dee140db52 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Received event network-vif-plugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-74c95505-6ea0-41d2-ba5e-fe6e7f7fd835 req-2575925d-8852-43ce-a87c-27dee140db52 service nova] Acquiring lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-74c95505-6ea0-41d2-ba5e-fe6e7f7fd835 req-2575925d-8852-43ce-a87c-27dee140db52 service nova] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-74c95505-6ea0-41d2-ba5e-fe6e7f7fd835 req-2575925d-8852-43ce-a87c-27dee140db52 service nova] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-74c95505-6ea0-41d2-ba5e-fe6e7f7fd835 req-2575925d-8852-43ce-a87c-27dee140db52 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] No waiting events found dispatching network-vif-plugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:30:37 user nova-compute[73067]: WARNING nova.compute.manager [req-74c95505-6ea0-41d2-ba5e-fe6e7f7fd835 req-2575925d-8852-43ce-a87c-27dee140db52 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Received unexpected event network-vif-plugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 for instance with vm_state building and task_state spawning.
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181837.7995439, f765ae8f-01ae-4eaf-a1ec-daaba1c72be1 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:30:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] VM Resumed (Lifecycle Event)
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:30:37 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Instance spawned successfully.
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:30:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181837.799911, f765ae8f-01ae-4eaf-a1ec-daaba1c72be1 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:30:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] VM Started (Lifecycle Event)
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:30:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:30:37 user nova-compute[73067]: INFO nova.compute.manager [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Took 6.90 seconds to spawn the instance on the hypervisor.
Aug 16 10:30:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:30:38 user nova-compute[73067]: INFO nova.compute.manager [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Took 8.26 seconds to build instance.
Aug 16 10:30:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef44e1f6-f30d-4df4-8cbb-3ffab07a9813 tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.433s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:30:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:30:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:30:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:30:54 user nova-compute[73067]: INFO nova.compute.claims [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Claim successful on node user
Aug 16 10:30:54 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 10:30:54 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 10:30:54 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 10:30:54 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 10:30:54 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 10:30:55 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:30:55 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:30:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:30:55 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:30:55 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:30:55 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:30:55 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:30:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:55 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:30:55 user nova-compute[73067]: INFO nova.virt.block_device [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Booting with volume 514d6e94-626c-48d2-9449-7d405704e8c5 at /dev/vda
Aug 16 10:30:55 user nova-compute[73067]: DEBUG nova.policy [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd4efb42518f456d882729f5876b0c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b257ac73941441bab8961b8ab61d2edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:30:55 user nova-compute[73067]: DEBUG os_brick.utils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:30:55 user nova-compute[73067]: INFO oslo.privsep.daemon [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpo4b922z0/privsep.sock']
Aug 16 10:30:55 user sudo[84162]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpo4b922z0/privsep.sock
Aug 16 10:30:55 user sudo[84162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 10:30:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully created port: 008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:30:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully created port: 32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:30:57 user sudo[84162]: pam_unix(sudo:session): session closed for user root
Aug 16 10:30:57 user nova-compute[73067]: INFO oslo.privsep.daemon [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Spawned new privsep daemon via rootwrap
Aug 16 10:30:57 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 10:30:57 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 10:30:57 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 16 10:30:57 user nova-compute[73067]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84181
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ce32c6-5fa0-4b18-bda2-3a03a5bfa14a]: (2,) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully created port: 615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb125f6-063a-462c-973b-a862ce867e4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:30:57 user nova-compute[73067]: WARNING os_brick.initiator.connectors.nvmeof [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[35850563-4bb0-49db-82e3-9050651c1012]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eff8677-03d7-49a7-bd21-4e1ace9ef362]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac243d-46a1-4276-8c93-cf09d039bf13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:30:57 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:30:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9c7f5a-b486-4d56-91c6-d5be9cdaa978]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG os_brick.utils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] <== get_connector_properties: return (2054ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:30:57 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating existing volume attachment record: fab60314-446c-4b59-ba44-37e2a09068fb {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:30:58 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully created port: 220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:30:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:30:58 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully created port: 059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:30:59 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully updated port: 008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-c87375a2-6329-4d71-a3c6-7a1ae878d69f req-5f010e8d-e0ba-48e6-b5b5-561da8189460 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-changed-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-c87375a2-6329-4d71-a3c6-7a1ae878d69f req-5f010e8d-e0ba-48e6-b5b5-561da8189460 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing instance network info cache due to event network-changed-008c71c2-37af-4e5c-bc2a-bdf5d684595f. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c87375a2-6329-4d71-a3c6-7a1ae878d69f req-5f010e8d-e0ba-48e6-b5b5-561da8189460 service nova] Acquiring lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c87375a2-6329-4d71-a3c6-7a1ae878d69f req-5f010e8d-e0ba-48e6-b5b5-561da8189460 service nova] Acquired lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:00 user nova-compute[73067]: DEBUG nova.network.neutron [req-c87375a2-6329-4d71-a3c6-7a1ae878d69f req-5f010e8d-e0ba-48e6-b5b5-561da8189460 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing network info cache for port 008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:00 user nova-compute[73067]: DEBUG nova.network.neutron [req-c87375a2-6329-4d71-a3c6-7a1ae878d69f req-5f010e8d-e0ba-48e6-b5b5-561da8189460 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:00 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully updated port: 73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:01 user nova-compute[73067]: DEBUG nova.network.neutron [req-c87375a2-6329-4d71-a3c6-7a1ae878d69f req-5f010e8d-e0ba-48e6-b5b5-561da8189460 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c87375a2-6329-4d71-a3c6-7a1ae878d69f req-5f010e8d-e0ba-48e6-b5b5-561da8189460 service nova] Releasing lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:01 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully updated port: 4aa4e892-0f74-44af-a97a-794f6e9f9708 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-changed-73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing instance network info cache due to event network-changed-73e02a1e-4582-4fd2-b9f7-d4f517272dcc. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] Acquiring lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] Acquired lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.network.neutron [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing network info cache for port 73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.network.neutron [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.network.neutron [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] Releasing lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-changed-4aa4e892-0f74-44af-a97a-794f6e9f9708 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing instance network info cache due to event network-changed-4aa4e892-0f74-44af-a97a-794f6e9f9708. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] Acquiring lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] Acquired lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.network.neutron [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing network info cache for port 4aa4e892-0f74-44af-a97a-794f6e9f9708 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully updated port: 32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.network.neutron [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:31:02 user nova-compute[73067]: INFO nova.compute.claims [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Claim successful on node user
Aug 16 10:31:02 user nova-compute[73067]: DEBUG nova.network.neutron [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2f3d43b4-e7e3-4269-85da-779dac23d4f6 req-518c4d6a-4f4d-48af-9152-1a32730cc287 service nova] Releasing lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully updated port: 615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:31:03 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:31:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:31:03 user nova-compute[73067]: INFO nova.virt.block_device [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Booting with volume 7f1dc418-28fc-4ebb-a684-1c16442608fe at /dev/vda
Aug 16 10:31:03 user nova-compute[73067]: DEBUG os_brick.utils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG nova.policy [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '999535c10b504af48797e8511fdf99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912f3a50bdde41b8ad33424f28d22145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cae3afb-823c-4dac-9bce-af85f2aedd03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[262efaab-105a-4643-a93c-bd0bb2db5169]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefdf417-2499-46fe-bedf-758a528c1067]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[429d9bd7-02c6-4056-8917-e33e5c342226]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:03 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:31:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[781500bb-7bb8-44ed-a887-226ad31e9cbc]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG os_brick.utils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:03 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating existing volume attachment record: 6d95b40d-b03e-4c73-a537-1ac160d08ed1 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-changed-32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing instance network info cache due to event network-changed-32592ea8-d95c-4230-bbaf-23bab3d70822. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] Acquiring lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] Acquired lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing network info cache for port 32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully updated port: 220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] Releasing lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-changed-615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing instance network info cache due to event network-changed-615324f2-1462-496f-a2e2-847c99c595cb. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] Acquiring lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] Acquired lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing network info cache for port 615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully created port: 7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:31:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:05 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Successfully updated port: 059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:05 user nova-compute[73067]: DEBUG nova.network.neutron [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-71c4f50b-fc39-4f82-94ad-3c391f077a32 req-ec4f3a32-b731-46d3-b344-eb6d0d4a4c6d service nova] Releasing lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquired lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:05 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:31:05 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-changed-220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing instance network info cache due to event network-changed-220a6015-5864-45e5-92f0-f0709163db38. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] Acquiring lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:06 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully created port: fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:31:07 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully created port: fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:31:08 user nova-compute[73067]: INFO nova.virt.block_device [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Booting with volume cba384d4-8b94-40b3-968f-548f9c412cff at /dev/vdb
Aug 16 10:31:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG os_brick.utils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a41ce8-2e85-4dd7-8513-038bb54f3854]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c04b787-5584-450a-a87b-06493394d6ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully created port: 367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47c67df-9bf2-468c-a6c6-cb6428675191]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf892b0-402a-4fa3-a3f2-3ee130a7a75e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:08 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:31:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f0c3d8-9660-4d99-b62d-71e0ca1ad100]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG os_brick.utils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:08 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating existing volume attachment record: f7ef411c-f01f-425e-a939-05ae939e6bab {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:31:09 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [{"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Releasing lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Instance network_info: |[{"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:31:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] Acquired lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:09 user nova-compute[73067]: DEBUG nova.network.neutron [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing network info cache for port 220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully created port: 8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG nova.network.neutron [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updated VIF entry in instance network info cache for port 220a6015-5864-45e5-92f0-f0709163db38. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG nova.network.neutron [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [{"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] Releasing lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-changed-059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing instance network info cache due to event network-changed-059ab46b-9eff-4581-b29d-9858760a64dc. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] Acquiring lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] Acquired lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG nova.network.neutron [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing network info cache for port 059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:10 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:31:10 user nova-compute[73067]: INFO nova.compute.claims [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Claim successful on node user
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.network.neutron [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updated VIF entry in instance network info cache for port 059ab46b-9eff-4581-b29d-9858760a64dc. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.network.neutron [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [{"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5486693d-08d7-41d9-9065-ee3fefe0a5e7 req-2d7c7a8c-828c-43b2-b026-e204ae09f8dd service nova] Releasing lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:31:11 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully updated port: 7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-8ac7aff9-3bc2-4eab-a7d6-77e2e09a22ac req-abf3a3b2-8bd5-4b0f-9ff4-e1c19f5eaca7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-changed-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-8ac7aff9-3bc2-4eab-a7d6-77e2e09a22ac req-abf3a3b2-8bd5-4b0f-9ff4-e1c19f5eaca7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing instance network info cache due to event network-changed-7af2b562-e0cb-4411-ab63-236edb74c04c. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8ac7aff9-3bc2-4eab-a7d6-77e2e09a22ac req-abf3a3b2-8bd5-4b0f-9ff4-e1c19f5eaca7 service nova] Acquiring lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8ac7aff9-3bc2-4eab-a7d6-77e2e09a22ac req-abf3a3b2-8bd5-4b0f-9ff4-e1c19f5eaca7 service nova] Acquired lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.network.neutron [req-8ac7aff9-3bc2-4eab-a7d6-77e2e09a22ac req-abf3a3b2-8bd5-4b0f-9ff4-e1c19f5eaca7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing network info cache for port 7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:31:11 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Creating image(s)
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "/opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "/opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.policy [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcce750fe55c44809a3c42265e64f54c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1171c517852847f5a1de1e6236fa753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.network.neutron [req-8ac7aff9-3bc2-4eab-a7d6-77e2e09a22ac req-abf3a3b2-8bd5-4b0f-9ff4-e1c19f5eaca7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG nova.network.neutron [req-8ac7aff9-3bc2-4eab-a7d6-77e2e09a22ac req-abf3a3b2-8bd5-4b0f-9ff4-e1c19f5eaca7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8ac7aff9-3bc2-4eab-a7d6-77e2e09a22ac req-abf3a3b2-8bd5-4b0f-9ff4-e1c19f5eaca7 service nova] Releasing lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk 1073741824" returned: 0 in 0.050s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.263s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Cannot resize image /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG nova.objects.instance [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'migration_context' on Instance uuid b8758033-0b89-4953-b96b-0dc227bb3a3d {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Ensure instance console log exists: /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:13 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully updated port: 3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:13 user nova-compute[73067]: DEBUG nova.network.neutron [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Successfully created port: 911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:31:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-e01147eb-f3dd-4d7f-ace2-9342a0cafb18 req-23790ee7-2169-4f09-9b4f-6927bcbfe720 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-changed-3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-e01147eb-f3dd-4d7f-ace2-9342a0cafb18 req-23790ee7-2169-4f09-9b4f-6927bcbfe720 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing instance network info cache due to event network-changed-3fb8bad8-53b7-452c-8887-670c2db92f1f. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e01147eb-f3dd-4d7f-ace2-9342a0cafb18 req-23790ee7-2169-4f09-9b4f-6927bcbfe720 service nova] Acquiring lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e01147eb-f3dd-4d7f-ace2-9342a0cafb18 req-23790ee7-2169-4f09-9b4f-6927bcbfe720 service nova] Acquired lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:13 user nova-compute[73067]: DEBUG nova.network.neutron [req-e01147eb-f3dd-4d7f-ace2-9342a0cafb18 req-23790ee7-2169-4f09-9b4f-6927bcbfe720 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing network info cache for port 3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:13 user nova-compute[73067]: DEBUG nova.network.neutron [req-e01147eb-f3dd-4d7f-ace2-9342a0cafb18 req-23790ee7-2169-4f09-9b4f-6927bcbfe720 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG nova.network.neutron [req-e01147eb-f3dd-4d7f-ace2-9342a0cafb18 req-23790ee7-2169-4f09-9b4f-6927bcbfe720 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e01147eb-f3dd-4d7f-ace2-9342a0cafb18 req-23790ee7-2169-4f09-9b4f-6927bcbfe720 service nova] Releasing lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully updated port: 7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:14 user nova-compute[73067]: INFO nova.virt.block_device [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Booting with volume e54dbc73-fb26-416a-9a71-95d17774f30c at /dev/vdb
Aug 16 10:31:14 user nova-compute[73067]: DEBUG os_brick.utils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[da285aa4-1887-4939-b710-e4e61719e64a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[541b253a-b49b-46fc-8c11-9860fcf59818]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Successfully updated port: 911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "refresh_cache-b8758033-0b89-4953-b96b-0dc227bb3a3d" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquired lock "refresh_cache-b8758033-0b89-4953-b96b-0dc227bb3a3d" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7243e3e5-97e1-4188-b601-e8e35f1b80c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97a0dc6-777f-4b1e-99d3-e492bae94c8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:14 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:31:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d8561a-4623-4a9a-8ed6-328242aafab4]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG os_brick.utils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating existing volume attachment record: ce8e5ae4-eaa3-4e3c-bb90-9bb642d78bbe {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:31:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Updating instance_info_cache with network_info: [{"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Releasing lock "refresh_cache-b8758033-0b89-4953-b96b-0dc227bb3a3d" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Instance network_info: |[{"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Start _get_guest_xml network_info=[{"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:31:15 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:31:15 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1663048354',display_name='tempest-VolumesSnapshotTestJSON-instance-1663048354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1663048354',id=12,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2mGK4KFS7l5nWcGBSUytiUP4Bk5Ll2gffv2s0kvwO9yJK4ljI7RS8S3y6rr2Omr6vGFVXMVTtap/WGTNmClXgVfXuWbufHTSfXI1WJQ7IdYsOZyI9R+aL+cPRNkaVdvQ==',key_name='tempest-keypair-817635519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1171c517852847f5a1de1e6236fa753e',ramdisk_id='',reservation_id='r-df6fkisd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-78639816',owner_user_name='tempest-VolumesSnapshotTestJSON-78639816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcce750fe55c44809a3c42265e64f54c',uuid=b8758033-0b89-4953-b96b-0dc227bb3a3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converting VIF {"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:de:c6,bridge_name='br-int',has_traffic_filtering=True,id=911406a5-d202-4d4a-88e0-237a6168701b,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911406a5-d2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.objects.instance [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'pci_devices' on Instance uuid b8758033-0b89-4953-b96b-0dc227bb3a3d {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:31:15 user nova-compute[73067]:   <uuid>b8758033-0b89-4953-b96b-0dc227bb3a3d</uuid>
Aug 16 10:31:15 user nova-compute[73067]:   <name>instance-0000000c</name>
Aug 16 10:31:15 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:31:15 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:31:15 user nova-compute[73067]:   <metadata>
Aug 16 10:31:15 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:31:15 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:31:15 user nova-compute[73067]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1663048354</nova:name>
Aug 16 10:31:15 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:31:15</nova:creationTime>
Aug 16 10:31:15 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:31:15 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:31:15 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:31:15 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:31:15 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:31:15 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:31:15 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:31:15 user nova-compute[73067]:       <nova:owner>
Aug 16 10:31:15 user nova-compute[73067]:         <nova:user uuid="dcce750fe55c44809a3c42265e64f54c">tempest-VolumesSnapshotTestJSON-78639816-project-member</nova:user>
Aug 16 10:31:15 user nova-compute[73067]:         <nova:project uuid="1171c517852847f5a1de1e6236fa753e">tempest-VolumesSnapshotTestJSON-78639816</nova:project>
Aug 16 10:31:15 user nova-compute[73067]:       </nova:owner>
Aug 16 10:31:15 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:31:15 user nova-compute[73067]:       <nova:ports>
Aug 16 10:31:15 user nova-compute[73067]:         <nova:port uuid="911406a5-d202-4d4a-88e0-237a6168701b">
Aug 16 10:31:15 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 10:31:15 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:15 user nova-compute[73067]:       </nova:ports>
Aug 16 10:31:15 user nova-compute[73067]:     </nova:instance>
Aug 16 10:31:15 user nova-compute[73067]:   </metadata>
Aug 16 10:31:15 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:31:15 user nova-compute[73067]:     <system>
Aug 16 10:31:15 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:31:15 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:31:15 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:31:15 user nova-compute[73067]:       <entry name="serial">b8758033-0b89-4953-b96b-0dc227bb3a3d</entry>
Aug 16 10:31:15 user nova-compute[73067]:       <entry name="uuid">b8758033-0b89-4953-b96b-0dc227bb3a3d</entry>
Aug 16 10:31:15 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:31:15 user nova-compute[73067]:     </system>
Aug 16 10:31:15 user nova-compute[73067]:   </sysinfo>
Aug 16 10:31:15 user nova-compute[73067]:   <os>
Aug 16 10:31:15 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:31:15 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:31:15 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:31:15 user nova-compute[73067]:   </os>
Aug 16 10:31:15 user nova-compute[73067]:   <features>
Aug 16 10:31:15 user nova-compute[73067]:     <acpi/>
Aug 16 10:31:15 user nova-compute[73067]:     <apic/>
Aug 16 10:31:15 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:31:15 user nova-compute[73067]:   </features>
Aug 16 10:31:15 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:31:15 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:31:15 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:31:15 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:31:15 user nova-compute[73067]:   </clock>
Aug 16 10:31:15 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:31:15 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:31:15 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:31:15 user nova-compute[73067]:   </cpu>
Aug 16 10:31:15 user nova-compute[73067]:   <devices>
Aug 16 10:31:15 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:31:15 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:31:15 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk"/>
Aug 16 10:31:15 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:31:15 user nova-compute[73067]:     </disk>
Aug 16 10:31:15 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:15 user nova-compute[73067]:       <mac address="fa:16:3e:a3:de:c6"/>
Aug 16 10:31:15 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:15 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:15 user nova-compute[73067]:       <target dev="tap911406a5-d2"/>
Aug 16 10:31:15 user nova-compute[73067]:     </interface>
Aug 16 10:31:15 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:31:15 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/console.log" append="off"/>
Aug 16 10:31:15 user nova-compute[73067]:     </serial>
Aug 16 10:31:15 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:31:15 user nova-compute[73067]:     <video>
Aug 16 10:31:15 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:15 user nova-compute[73067]:     </video>
Aug 16 10:31:15 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:31:15 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:31:15 user nova-compute[73067]:     </rng>
Aug 16 10:31:15 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:31:15 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:31:15 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:31:15 user nova-compute[73067]:     </memballoon>
Aug 16 10:31:15 user nova-compute[73067]:   </devices>
Aug 16 10:31:15 user nova-compute[73067]: </domain>
Aug 16 10:31:15 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1663048354',display_name='tempest-VolumesSnapshotTestJSON-instance-1663048354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1663048354',id=12,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2mGK4KFS7l5nWcGBSUytiUP4Bk5Ll2gffv2s0kvwO9yJK4ljI7RS8S3y6rr2Omr6vGFVXMVTtap/WGTNmClXgVfXuWbufHTSfXI1WJQ7IdYsOZyI9R+aL+cPRNkaVdvQ==',key_name='tempest-keypair-817635519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1171c517852847f5a1de1e6236fa753e',ramdisk_id='',reservation_id='r-df6fkisd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-78639816',owner_user_name='tempest-VolumesSnapshotTestJSON-78639816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcce750fe55c44809a3c42265e64f54c',uuid=b8758033-0b89-4953-b96b-0dc227bb3a3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converting VIF {"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:de:c6,bridge_name='br-int',has_traffic_filtering=True,id=911406a5-d202-4d4a-88e0-237a6168701b,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911406a5-d2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG os_vif [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:de:c6,bridge_name='br-int',has_traffic_filtering=True,id=911406a5-d202-4d4a-88e0-237a6168701b,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911406a5-d2') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap911406a5-d2, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap911406a5-d2, col_values=(('external_ids', {'iface-id': '911406a5-d202-4d4a-88e0-237a6168701b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:de:c6', 'vm-uuid': 'b8758033-0b89-4953-b96b-0dc227bb3a3d'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:15 user nova-compute[73067]: INFO os_vif [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:de:c6,bridge_name='br-int',has_traffic_filtering=True,id=911406a5-d202-4d4a-88e0-237a6168701b,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911406a5-d2')
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] No VIF found with MAC fa:16:3e:a3:de:c6, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully updated port: fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-changed-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing instance network info cache due to event network-changed-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] Acquiring lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] Acquired lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.network.neutron [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing network info cache for port 7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:15 user nova-compute[73067]: DEBUG nova.network.neutron [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:16 user nova-compute[73067]: DEBUG nova.network.neutron [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] Releasing lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received event network-changed-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Refreshing instance network info cache due to event network-changed-911406a5-d202-4d4a-88e0-237a6168701b. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] Acquiring lock "refresh_cache-b8758033-0b89-4953-b96b-0dc227bb3a3d" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] Acquired lock "refresh_cache-b8758033-0b89-4953-b96b-0dc227bb3a3d" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:16 user nova-compute[73067]: DEBUG nova.network.neutron [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Refreshing network info cache for port 911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:16 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully updated port: fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.network.neutron [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Updated VIF entry in instance network info cache for port 911406a5-d202-4d4a-88e0-237a6168701b. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.network.neutron [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Updating instance_info_cache with network_info: [{"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] Releasing lock "refresh_cache-b8758033-0b89-4953-b96b-0dc227bb3a3d" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-changed-fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing instance network info cache due to event network-changed-fb1cbdeb-3468-4c81-a757-3b54f92aa510. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] Acquiring lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] Acquired lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.network.neutron [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing network info cache for port fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-b6f294ae-e51d-4fb3-bd4e-03dbddf3b1a2 req-37b23815-22cd-48cb-812a-6a2b65724560 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received event network-vif-plugged-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b6f294ae-e51d-4fb3-bd4e-03dbddf3b1a2 req-37b23815-22cd-48cb-812a-6a2b65724560 service nova] Acquiring lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b6f294ae-e51d-4fb3-bd4e-03dbddf3b1a2 req-37b23815-22cd-48cb-812a-6a2b65724560 service nova] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b6f294ae-e51d-4fb3-bd4e-03dbddf3b1a2 req-37b23815-22cd-48cb-812a-6a2b65724560 service nova] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-b6f294ae-e51d-4fb3-bd4e-03dbddf3b1a2 req-37b23815-22cd-48cb-812a-6a2b65724560 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] No waiting events found dispatching network-vif-plugged-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:17 user nova-compute[73067]: WARNING nova.compute.manager [req-b6f294ae-e51d-4fb3-bd4e-03dbddf3b1a2 req-37b23815-22cd-48cb-812a-6a2b65724560 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received unexpected event network-vif-plugged-911406a5-d202-4d4a-88e0-237a6168701b for instance with vm_state building and task_state spawning.
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.network.neutron [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-0a65e257-fd36-4a85-8631-e0d247c4c311 req-65f133ec-9095-49f7-903e-83f2b06086dd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-changed-fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-0a65e257-fd36-4a85-8631-e0d247c4c311 req-65f133ec-9095-49f7-903e-83f2b06086dd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing instance network info cache due to event network-changed-fe03e438-e13b-4b98-bd68-ff3638588926. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0a65e257-fd36-4a85-8631-e0d247c4c311 req-65f133ec-9095-49f7-903e-83f2b06086dd service nova] Acquiring lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.network.neutron [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79d8aa40-6c4f-405f-90ba-d45791186979 req-ff8b80ec-3418-49c5-a676-ab7f44307238 service nova] Releasing lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0a65e257-fd36-4a85-8631-e0d247c4c311 req-65f133ec-9095-49f7-903e-83f2b06086dd service nova] Acquired lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.network.neutron [req-0a65e257-fd36-4a85-8631-e0d247c4c311 req-65f133ec-9095-49f7-903e-83f2b06086dd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing network info cache for port fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:17 user nova-compute[73067]: DEBUG nova.network.neutron [req-0a65e257-fd36-4a85-8631-e0d247c4c311 req-65f133ec-9095-49f7-903e-83f2b06086dd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-0a65e257-fd36-4a85-8631-e0d247c4c311 req-65f133ec-9095-49f7-903e-83f2b06086dd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0a65e257-fd36-4a85-8631-e0d247c4c311 req-65f133ec-9095-49f7-903e-83f2b06086dd service nova] Releasing lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:18 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully updated port: 367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181879.125316, b8758033-0b89-4953-b96b-0dc227bb3a3d => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:31:19 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] VM Resumed (Lifecycle Event)
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:31:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Instance spawned successfully.
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:31:19 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181879.1270037, b8758033-0b89-4953-b96b-0dc227bb3a3d => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:31:19 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] VM Started (Lifecycle Event)
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Successfully updated port: 8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:19 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquired lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:31:19 user nova-compute[73067]: INFO nova.compute.manager [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Took 7.66 seconds to spawn the instance on the hypervisor.
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-8f0ca634-a29f-4e50-a0f9-968fa96141ac req-3e94a8b5-1163-4d67-b67e-ab35a64c1223 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received event network-vif-plugged-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8f0ca634-a29f-4e50-a0f9-968fa96141ac req-3e94a8b5-1163-4d67-b67e-ab35a64c1223 service nova] Acquiring lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8f0ca634-a29f-4e50-a0f9-968fa96141ac req-3e94a8b5-1163-4d67-b67e-ab35a64c1223 service nova] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8f0ca634-a29f-4e50-a0f9-968fa96141ac req-3e94a8b5-1163-4d67-b67e-ab35a64c1223 service nova] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-8f0ca634-a29f-4e50-a0f9-968fa96141ac req-3e94a8b5-1163-4d67-b67e-ab35a64c1223 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] No waiting events found dispatching network-vif-plugged-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:19 user nova-compute[73067]: WARNING nova.compute.manager [req-8f0ca634-a29f-4e50-a0f9-968fa96141ac req-3e94a8b5-1163-4d67-b67e-ab35a64c1223 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received unexpected event network-vif-plugged-911406a5-d202-4d4a-88e0-237a6168701b for instance with vm_state building and task_state spawning.
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:19 user nova-compute[73067]: INFO nova.compute.manager [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Took 8.61 seconds to build instance.
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-807b3619-062b-4974-83f0-e08cdbc41257 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.708s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:19 user nova-compute[73067]: INFO nova.virt.block_device [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Booting with volume a0821e48-26bb-4b64-b7b0-67159069c8ba at /dev/vdc
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-changed-367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing instance network info cache due to event network-changed-367839d4-788f-4f24-9c3e-9df8ff551c87. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] Acquiring lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG os_brick.utils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[774cf464-290f-4ea5-960f-7c3d45d962e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9aa8ac-d5eb-4774-93ab-c2b9dad20fde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[df674ada-dc1e-4c11-b6e6-cf7f8370e948]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c372820-4b80-4f4e-a50a-da15ab1ed9bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:20 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:31:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75c6108-2f8d-4fc0-925e-9640fbf378d7]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG os_brick.utils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating existing volume attachment record: cf1808ac-889a-4e87-8729-93b35d43a104 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG nova.objects.instance [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lazy-loading 'flavor' on Instance uuid 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [{"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Releasing lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Instance network_info: |[{"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] Acquired lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG nova.network.neutron [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing network info cache for port 367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:21 user nova-compute[73067]: INFO nova.compute.manager [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Attaching volume fe526eb8-102b-4749-aed9-9af2ee149fe0 to /dev/vdb
Aug 16 10:31:21 user nova-compute[73067]: DEBUG os_brick.utils [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a2a6da-cebd-4b72-b758-ce417e7d99ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc1ff09-7133-4fc5-bcf2-84a32b0fa728]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[119c0f14-cfb3-4207-a921-7fe60530ed62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bb8af5-d8e5-4490-9dda-7af325628427]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:21 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:31:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9c771f-2713-4ca6-94fb-9cfff599219a]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG os_brick.utils [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:21 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Updating existing volume attachment record: 4ce816e5-cc1c-489a-829e-9ecd9c2576ab {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updated VIF entry in instance network info cache for port 367839d4-788f-4f24-9c3e-9df8ff551c87. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [{"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] Releasing lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-changed-8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing instance network info cache due to event network-changed-8dce82be-b2e8-47c2-830c-1040265820b7. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] Acquiring lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] Acquired lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing network info cache for port 8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updated VIF entry in instance network info cache for port 8dce82be-b2e8-47c2-830c-1040265820b7. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [{"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3e17c1f7-dd59-40a2-ac8f-1240a05bf783 req-2852013e-3da4-47d7-9228-2ee0ab2153d4 service nova] Releasing lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:31:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:31:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:31:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:31:26 user nova-compute[73067]: INFO nova.virt.block_device [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Booting with volume 37891010-9dac-4458-9675-352492b59390 at /dev/vdc
Aug 16 10:31:26 user nova-compute[73067]: DEBUG os_brick.utils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffbb67c-f19c-447b-ae44-5677fbb935ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5315c81-d883-42e5-b735-be4b78ca2cca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bd475d-c7f5-4d81-9e87-71a4a24a9952]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[90be3288-6bfd-489e-83b7-f569df3b8705]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:26 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f839a734-8d70-4b36-a19a-3d2f77c8a4ce]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG os_brick.utils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating existing volume attachment record: f9416898-5400-4661-a053-4942a562e623 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:31:27 user nova-compute[73067]: INFO nova.compute.claims [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Claim successful on node user
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG nova.network.neutron [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:31:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:31:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG nova.policy [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c965df8f8c240438581033b9004bea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56c1ffc9f4b4b63a31c6020cdc12f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:31:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Creating image(s)
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "/opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "/opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk 1073741824" returned: 0 in 0.088s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Successfully created port: 7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.204s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Cannot resize image /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.objects.instance [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lazy-loading 'migration_context' on Instance uuid 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Ensure instance console log exists: /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Successfully updated port: 7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "refresh_cache-4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquired lock "refresh_cache-4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-93692e61-a251-422a-8cfd-993bb0ed792f req-3f863ffb-8d39-4193-bdc1-db1c7f1baa52 service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Received event network-changed-7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-93692e61-a251-422a-8cfd-993bb0ed792f req-3f863ffb-8d39-4193-bdc1-db1c7f1baa52 service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Refreshing instance network info cache due to event network-changed-7bd3051a-5dc0-49c2-8f7c-453aaf11590e. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-93692e61-a251-422a-8cfd-993bb0ed792f req-3f863ffb-8d39-4193-bdc1-db1c7f1baa52 service nova] Acquiring lock "refresh_cache-4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.network.neutron [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Updating instance_info_cache with network_info: [{"id": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "address": "fa:16:3e:fb:5a:de", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd3051a-5d", "ovs_interfaceid": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Releasing lock "refresh_cache-4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Instance network_info: |[{"id": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "address": "fa:16:3e:fb:5a:de", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd3051a-5d", "ovs_interfaceid": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-93692e61-a251-422a-8cfd-993bb0ed792f req-3f863ffb-8d39-4193-bdc1-db1c7f1baa52 service nova] Acquired lock "refresh_cache-4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.network.neutron [req-93692e61-a251-422a-8cfd-993bb0ed792f req-3f863ffb-8d39-4193-bdc1-db1c7f1baa52 service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Refreshing network info cache for port 7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Start _get_guest_xml network_info=[{"id": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "address": "fa:16:3e:fb:5a:de", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd3051a-5d", "ovs_interfaceid": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:30 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:31:30 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2059202362',display_name='tempest-ServersNegativeTestJSON-server-2059202362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2059202362',id=13,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c1ffc9f4b4b63a31c6020cdc12f96',ramdisk_id='',reservation_id='r-zfp0011a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-29460834',owner_user_name='tempest-ServersNegativeTestJSON-29460834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:28Z,user_data=None,user_id='7c965df8f8c240438581033b9004bea3',uuid=4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "address": "fa:16:3e:fb:5a:de", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd3051a-5d", "ovs_interfaceid": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converting VIF {"id": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "address": "fa:16:3e:fb:5a:de", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd3051a-5d", "ovs_interfaceid": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=7bd3051a-5dc0-49c2-8f7c-453aaf11590e,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd3051a-5d') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.objects.instance [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:31:30 user nova-compute[73067]:   <uuid>4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5</uuid>
Aug 16 10:31:30 user nova-compute[73067]:   <name>instance-0000000d</name>
Aug 16 10:31:30 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:31:30 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:31:30 user nova-compute[73067]:   <metadata>
Aug 16 10:31:30 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:31:30 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:31:30 user nova-compute[73067]:       <nova:name>tempest-ServersNegativeTestJSON-server-2059202362</nova:name>
Aug 16 10:31:30 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:31:30</nova:creationTime>
Aug 16 10:31:30 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:31:30 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:31:30 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:31:30 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:31:30 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:31:30 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:31:30 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:31:30 user nova-compute[73067]:       <nova:owner>
Aug 16 10:31:30 user nova-compute[73067]:         <nova:user uuid="7c965df8f8c240438581033b9004bea3">tempest-ServersNegativeTestJSON-29460834-project-member</nova:user>
Aug 16 10:31:30 user nova-compute[73067]:         <nova:project uuid="c56c1ffc9f4b4b63a31c6020cdc12f96">tempest-ServersNegativeTestJSON-29460834</nova:project>
Aug 16 10:31:30 user nova-compute[73067]:       </nova:owner>
Aug 16 10:31:30 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:31:30 user nova-compute[73067]:       <nova:ports>
Aug 16 10:31:30 user nova-compute[73067]:         <nova:port uuid="7bd3051a-5dc0-49c2-8f7c-453aaf11590e">
Aug 16 10:31:30 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 10:31:30 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:30 user nova-compute[73067]:       </nova:ports>
Aug 16 10:31:30 user nova-compute[73067]:     </nova:instance>
Aug 16 10:31:30 user nova-compute[73067]:   </metadata>
Aug 16 10:31:30 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:31:30 user nova-compute[73067]:     <system>
Aug 16 10:31:30 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:31:30 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:31:30 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:31:30 user nova-compute[73067]:       <entry name="serial">4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5</entry>
Aug 16 10:31:30 user nova-compute[73067]:       <entry name="uuid">4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5</entry>
Aug 16 10:31:30 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:31:30 user nova-compute[73067]:     </system>
Aug 16 10:31:30 user nova-compute[73067]:   </sysinfo>
Aug 16 10:31:30 user nova-compute[73067]:   <os>
Aug 16 10:31:30 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:31:30 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:31:30 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:31:30 user nova-compute[73067]:   </os>
Aug 16 10:31:30 user nova-compute[73067]:   <features>
Aug 16 10:31:30 user nova-compute[73067]:     <acpi/>
Aug 16 10:31:30 user nova-compute[73067]:     <apic/>
Aug 16 10:31:30 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:31:30 user nova-compute[73067]:   </features>
Aug 16 10:31:30 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:31:30 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:31:30 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:31:30 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:31:30 user nova-compute[73067]:   </clock>
Aug 16 10:31:30 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:31:30 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:31:30 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:31:30 user nova-compute[73067]:   </cpu>
Aug 16 10:31:30 user nova-compute[73067]:   <devices>
Aug 16 10:31:30 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:31:30 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:31:30 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk"/>
Aug 16 10:31:30 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:31:30 user nova-compute[73067]:     </disk>
Aug 16 10:31:30 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:30 user nova-compute[73067]:       <mac address="fa:16:3e:fb:5a:de"/>
Aug 16 10:31:30 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:30 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:30 user nova-compute[73067]:       <target dev="tap7bd3051a-5d"/>
Aug 16 10:31:30 user nova-compute[73067]:     </interface>
Aug 16 10:31:30 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:31:30 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/console.log" append="off"/>
Aug 16 10:31:30 user nova-compute[73067]:     </serial>
Aug 16 10:31:30 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:31:30 user nova-compute[73067]:     <video>
Aug 16 10:31:30 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:30 user nova-compute[73067]:     </video>
Aug 16 10:31:30 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:31:30 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:31:30 user nova-compute[73067]:     </rng>
Aug 16 10:31:30 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:31:30 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:31:30 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:31:30 user nova-compute[73067]:     </memballoon>
Aug 16 10:31:30 user nova-compute[73067]:   </devices>
Aug 16 10:31:30 user nova-compute[73067]: </domain>
Aug 16 10:31:30 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2059202362',display_name='tempest-ServersNegativeTestJSON-server-2059202362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2059202362',id=13,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c1ffc9f4b4b63a31c6020cdc12f96',ramdisk_id='',reservation_id='r-zfp0011a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-29460834',owner_user_name='tempest-ServersNegativeTestJSON-29460834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:28Z,user_data=None,user_id='7c965df8f8c240438581033b9004bea3',uuid=4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "address": "fa:16:3e:fb:5a:de", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd3051a-5d", "ovs_interfaceid": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converting VIF {"id": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "address": "fa:16:3e:fb:5a:de", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd3051a-5d", "ovs_interfaceid": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=7bd3051a-5dc0-49c2-8f7c-453aaf11590e,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd3051a-5d') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG os_vif [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=7bd3051a-5dc0-49c2-8f7c-453aaf11590e,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd3051a-5d') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bd3051a-5d, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7bd3051a-5d, col_values=(('external_ids', {'iface-id': '7bd3051a-5dc0-49c2-8f7c-453aaf11590e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:5a:de', 'vm-uuid': '4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:30 user nova-compute[73067]: INFO os_vif [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=7bd3051a-5dc0-49c2-8f7c-453aaf11590e,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd3051a-5d')
Aug 16 10:31:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:31 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:31:31 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=6960MB free_disk=25.604209899902344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] No VIF found with MAC fa:16:3e:fb:5a:de, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b8758033-0b89-4953-b96b-0dc227bb3a3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f765ae8f-01ae-4eaf-a1ec-daaba1c72be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 65299891-9731-4b3b-b23e-85813d45eb58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a050d0a6-0349-478a-8efc-fc4907ed20da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b51879a0-d5a1-4f96-b0c1-0672d31e80db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:31:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-93692e61-a251-422a-8cfd-993bb0ed792f req-3f863ffb-8d39-4193-bdc1-db1c7f1baa52 service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Updated VIF entry in instance network info cache for port 7bd3051a-5dc0-49c2-8f7c-453aaf11590e. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-93692e61-a251-422a-8cfd-993bb0ed792f req-3f863ffb-8d39-4193-bdc1-db1c7f1baa52 service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Updating instance_info_cache with network_info: [{"id": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "address": "fa:16:3e:fb:5a:de", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd3051a-5d", "ovs_interfaceid": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-93692e61-a251-422a-8cfd-993bb0ed792f req-3f863ffb-8d39-4193-bdc1-db1c7f1baa52 service nova] Releasing lock "refresh_cache-4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:31:32 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Creating image(s)
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Ensure instance console log exists: /opt/stack/data/nova/instances/11f1d48e-6575-46e8-87a7-ab9defb8a7d7/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Start _get_guest_xml network_info=[{"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLedAaUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11f1d48e-6575-46e8-87a7-ab9defb8a7d7', 'attached_at': '', 'detached_at': '', 'volume_id': '514d6e94-626c-48d2-9449-7d405704e8c5', 'serial': '514d6e94-626c-48d2-9449-7d405704e8c5'}, 'delete_on_termination': False, 'attachment_id': 'fab60314-446c-4b59-ba44-37e2a09068fb', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qySoxJYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11f1d48e-6575-46e8-87a7-ab9defb8a7d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'cba384d4-8b94-40b3-968f-548f9c412cff', 'serial': 'cba384d4-8b94-40b3-968f-548f9c412cff'}, 'delete_on_termination': False, 'attachment_id': 'f7ef411c-f01f-425e-a939-05ae939e6bab', 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkIGXmFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11f1d48e-6575-46e8-87a7-ab9defb8a7d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0821e48-26bb-4b64-b7b0-67159069c8ba', 'serial': 'a0821e48-26bb-4b64-b7b0-67159069c8ba'}, 'delete_on_termination': False, 'attachment_id': 'cf1808ac-889a-4e87-8729-93b35d43a104', 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:31:32 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:31:32 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connector [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Factory for ISCSI on None {{(pid=73067) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLedAaUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:32 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:32 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:32 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b172cb4-fd0e-4779-9a3e-f6640c0d7f2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:31:32 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2174b3c9-7d2f-4151-86d2-1de00e11a7b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5] added
Aug 16 10:31:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ad1934-e0a8-4902-8d2b-f844060807ee]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebeff23-d9df-4c74-9253-da6dd0e0193a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLedAaUp {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLedAaUp" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0135623d-b8a3-4d1f-9757-12480a1ecff5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sLedAaUp'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eec2f71-3ab0-45ac-90c8-62ee673041a6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3abf36-d9d5-4a8e-8e14-5faa07098d3c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 10:31:32 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 10:31:32 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:32 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 10:31:32 user nova-compute[73067]: 
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f3236-1307-4dac-8e26-c811b313f4f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5, portal: 172.16.0.220,3260]
Aug 16 10:31:32 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5, portal: 172.16.0.220,3260] successful.
Aug 16 10:31:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[79921f67-0f79-49cc-b11e-930b8bc34e1a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6ae63d-1185-4427-a28e-8608817b1941]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.045s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc628e6-c3a7-4049-90f0-1d4594cb2e0d]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLedAaUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-69e28f5b-0308-4202-a6f0-05cc30ae18bc req-c27b6f8d-3270-4e8a-96a1-9e1771306a97 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received event network-changed-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-69e28f5b-0308-4202-a6f0-05cc30ae18bc req-c27b6f8d-3270-4e8a-96a1-9e1771306a97 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Refreshing instance network info cache due to event network-changed-3d884641-f0de-4b61-a8e7-c7791ec28e2d. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-69e28f5b-0308-4202-a6f0-05cc30ae18bc req-c27b6f8d-3270-4e8a-96a1-9e1771306a97 service nova] Acquiring lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-69e28f5b-0308-4202-a6f0-05cc30ae18bc req-c27b6f8d-3270-4e8a-96a1-9e1771306a97 service nova] Acquired lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-69e28f5b-0308-4202-a6f0-05cc30ae18bc req-c27b6f8d-3270-4e8a-96a1-9e1771306a97 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Refreshing network info cache for port 3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-f2a49d8c-05d4-46ca-b48d-47e836526f97 req-fbe4732e-d906-494b-aac9-5e5139cb277d service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Received event network-vif-plugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f2a49d8c-05d4-46ca-b48d-47e836526f97 req-fbe4732e-d906-494b-aac9-5e5139cb277d service nova] Acquiring lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f2a49d8c-05d4-46ca-b48d-47e836526f97 req-fbe4732e-d906-494b-aac9-5e5139cb277d service nova] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f2a49d8c-05d4-46ca-b48d-47e836526f97 req-fbe4732e-d906-494b-aac9-5e5139cb277d service nova] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-f2a49d8c-05d4-46ca-b48d-47e836526f97 req-fbe4732e-d906-494b-aac9-5e5139cb277d service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] No waiting events found dispatching network-vif-plugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:33 user nova-compute[73067]: WARNING nova.compute.manager [req-f2a49d8c-05d4-46ca-b48d-47e836526f97 req-fbe4732e-d906-494b-aac9-5e5139cb277d service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Received unexpected event network-vif-plugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e for instance with vm_state building and task_state spawning.
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23964313063616237', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964313063616237', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qySoxJYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:33 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:33 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:33 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4285bbc6-c034-4299-a9d4-9919bbed52ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:31:33 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-69e28f5b-0308-4202-a6f0-05cc30ae18bc req-c27b6f8d-3270-4e8a-96a1-9e1771306a97 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updated VIF entry in instance network info cache for port 3d884641-f0de-4b61-a8e7-c7791ec28e2d. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-69e28f5b-0308-4202-a6f0-05cc30ae18bc req-c27b6f8d-3270-4e8a-96a1-9e1771306a97 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updating instance_info_cache with network_info: [{"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-69e28f5b-0308-4202-a6f0-05cc30ae18bc req-c27b6f8d-3270-4e8a-96a1-9e1771306a97 service nova] Releasing lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[07af6389-4a10-40c5-a51a-51034d2dcd15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff] added
Aug 16 10:31:33 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcf8a29-040e-4c5c-ba7e-1f5f450a064a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHnKMrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:33 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[467b3daf-f93a-43e4-83eb-57cbde7499b9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qySoxJYE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Updating instance_info_cache with network_info: [{"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qySoxJYE" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b3deb-7367-447a-a99a-d578413f51a6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qySoxJYE'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86a183d-fe76-4386-a132-939ea2186968]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2837c7-69ac-4774-ad4d-c75d835d2ee4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:34 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:34 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[35df6159-df4e-4184-a85e-9bf51b2ecc12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff, portal: 172.16.0.220,3260]
Aug 16 10:31:34 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff, portal: 172.16.0.220,3260] successful.
Aug 16 10:31:34 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88126d6-0fcf-4486-9723-295f20788115]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff92b55-59e3-4b03-a385-17a35a6cd5cf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:34 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:34 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:34 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:34 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0f148a-25b1-47ee-8606-c0f8512ce22c]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:31:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qySoxJYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181895.0144343, 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:31:35 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] VM Resumed (Lifecycle Event)
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:31:35 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Instance spawned successfully.
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:35 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181895.0175736, 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:31:35 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] VM Started (Lifecycle Event)
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:31:35 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:31:35 user nova-compute[73067]: INFO nova.compute.manager [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Took 6.73 seconds to spawn the instance on the hypervisor.
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:35 user nova-compute[73067]: INFO nova.compute.manager [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Took 7.87 seconds to build instance.
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26362313835353364', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362313835353364', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.275s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:35 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:35 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-89f3e44a-344f-4c7a-870f-35d59015212e tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.981s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a3d671-9b38-4577-b7a4-ec031418bcf5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:31:35 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkIGXmFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:35 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf39eec8-a52e-4b20-9b7a-46ffe4761ef8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0] added
Aug 16 10:31:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9901e1-f435-4135-9b2c-f49fc4305139]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd375b9-c674-4a51-b8b3-6df554a844ba]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzHnKMrO {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzHnKMrO" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc38660a-242e-4ba0-8c7d-f37f5cfd9f25]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzHnKMrO'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83dcec1-2c2a-4010-932b-39001710325c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Received event network-vif-plugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] Acquiring lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] No waiting events found dispatching network-vif-plugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:35 user nova-compute[73067]: WARNING nova.compute.manager [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Received unexpected event network-vif-plugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e for instance with vm_state active and task_state None.
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-changed-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Refreshing instance network info cache due to event network-changed-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] Acquiring lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] Acquired lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.network.neutron [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Refreshing network info cache for port c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef125bc-adbf-4abf-ab97-9aaf92d689a5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:35 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:35 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[626a3cc5-323c-452f-a5f8-90dadae0a0d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0, portal: 172.16.0.220,3260]
Aug 16 10:31:35 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0, portal: 172.16.0.220,3260] successful.
Aug 16 10:31:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fd970d-75f7-4a40-9693-366a242f89a8]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc18d1c-2081-4b29-84cb-1bee6062f8a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:35 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:35 user nova-compute[73067]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)
Aug 16 10:31:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:35 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:35 user nova-compute[73067]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)
Aug 16 10:31:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[32550fee-5aba-4c3c-a63c-62de34c79303]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHnKMrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.network.neutron [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updated VIF entry in instance network info cache for port c50ee3f9-3e3b-4896-a303-bdbf8153b3a1. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.network.neutron [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updating instance_info_cache with network_info: [{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d99744f9-b416-4d52-b0b0-badbb11f5495 req-3bdffab5-5756-4a3f-9305-fefd13a49bb4 service nova] Releasing lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:36 user nova-compute[73067]: INFO nova.compute.manager [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] instance snapshotting
Aug 16 10:31:36 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Beginning live snapshot process
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json -f qcow2 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json -f qcow2 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] <== connect_volume: return (2666ms) {'type': 'block', 'scsi_wwn': '23733616531613831', 'path': '/dev/sdd'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733616531613831', 'path': '/dev/sdd'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.356s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:36 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:36 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG nova.objects.instance [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lazy-loading 'flavor' on Instance uuid 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eede9a-202b-4fb4-9642-1b635a867be9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:31:36 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b309bb2-7982-4bfe-8f0d-7638293a4a23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba] added
Aug 16 10:31:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e1f773-04e0-479c-bede-16b820e3dace]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:31:36 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:31:36 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 10:31:36 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:31:36 user nova-compute[73067]:   <serial>fe526eb8-102b-4749-aed9-9af2ee149fe0</serial>
Aug 16 10:31:36 user nova-compute[73067]: </disk>
Aug 16 10:31:36 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f89e0a1-a5b1-46f0-b21a-9aeafa487462]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkIGXmFW {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkIGXmFW" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c88d654-2493-41b2-89e6-fbde1c8c8421]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RkIGXmFW'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b587bc-3b5e-4a6f-aea6-fb08fedbcb55]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4353c452-53ef-4945-aaa0-9edc7eadefa5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:36 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:36 user nova-compute[73067]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)
Aug 16 10:31:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:36 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:36 user nova-compute[73067]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)
Aug 16 10:31:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[def6082b-d666-474f-9323-1708eea7c040]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba, portal: 172.16.0.220,3260]
Aug 16 10:31:36 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba, portal: 172.16.0.220,3260] successful.
Aug 16 10:31:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[04add50d-53bf-46f7-99f0-d5ec320bc5d4]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.222s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4l53jlwy/f20828636caa4f2291fccbfa4acc80c2.delta 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1a9998-18ba-4ffb-b47e-69a2a65617e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:36 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:36 user nova-compute[73067]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)
Aug 16 10:31:36 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:36 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:36 user nova-compute[73067]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)
Aug 16 10:31:36 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4l53jlwy/f20828636caa4f2291fccbfa4acc80c2.delta 1073741824" returned: 0 in 0.050s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:37 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 10:31:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73067) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 16 10:31:37 user nova-compute[73067]: INFO nova.virt.libvirt.host [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] UEFI support detected
Aug 16 10:31:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[275a554f-c0b7-4e04-85d1-8f8881785eb3]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkIGXmFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] No VIF found with MAC fa:16:3e:30:2c:35, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bc65adbd-0aa3-4c4f-89c8-da989a7ac39f tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.720s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:37 user nova-compute[73067]: INFO nova.compute.manager [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Terminating instance
Aug 16 10:31:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] <== connect_volume: return (2792ms) {'type': 'block', 'scsi_wwn': '23262316539313533', 'path': '/dev/sde'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262316539313533', 'path': '/dev/sde'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:de:eb,bridge_name='br-int',has_traffic_filtering=True,id=008c71c2-37af-4e5c-bc2a-bdf5d684595f,network=Network(092e531c-7d7e-4849-a96b-ba6a51e3ab21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008c71c2-37') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:4d:ef,bridge_name='br-int',has_traffic_filtering=True,id=73e02a1e-4582-4fd2-b9f7-d4f517272dcc,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73e02a1e-45') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:28:de,bridge_name='br-int',has_traffic_filtering=True,id=4aa4e892-0f74-44af-a97a-794f6e9f9708,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4aa4e892-0f') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=32592ea8-d95c-4230-bbaf-23bab3d70822,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32592ea8-d9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:14:da,bridge_name='br-int',has_traffic_filtering=True,id=615324f2-1462-496f-a2e2-847c99c595cb,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap615324f2-14') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:42,bridge_name='br-int',has_traffic_filtering=True,id=220a6015-5864-45e5-92f0-f0709163db38,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220a6015-58') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=059ab46b-9eff-4581-b29d-9858760a64dc,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ab46b-9e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.objects.instance [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lazy-loading 'pci_devices' on Instance uuid 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:31:38 user nova-compute[73067]:   <uuid>11f1d48e-6575-46e8-87a7-ab9defb8a7d7</uuid>
Aug 16 10:31:38 user nova-compute[73067]:   <name>instance-0000000a</name>
Aug 16 10:31:38 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:31:38 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:31:38 user nova-compute[73067]:   <metadata>
Aug 16 10:31:38 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:31:38 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:31:38 user nova-compute[73067]:       <nova:name>tempest-device-tagging-server-293134366</nova:name>
Aug 16 10:31:38 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:31:32</nova:creationTime>
Aug 16 10:31:38 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:31:38 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:31:38 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:31:38 user nova-compute[73067]:       <nova:owner>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:user uuid="fd4efb42518f456d882729f5876b0c85">tempest-TaggedBootDevicesTest_v242-1241779598-project-member</nova:user>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:project uuid="b257ac73941441bab8961b8ab61d2edf">tempest-TaggedBootDevicesTest_v242-1241779598</nova:project>
Aug 16 10:31:38 user nova-compute[73067]:       </nova:owner>
Aug 16 10:31:38 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:31:38 user nova-compute[73067]:       <nova:ports>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:port uuid="008c71c2-37af-4e5c-bc2a-bdf5d684595f">
Aug 16 10:31:38 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 10:31:38 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:port uuid="73e02a1e-4582-4fd2-b9f7-d4f517272dcc">
Aug 16 10:31:38 user nova-compute[73067]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Aug 16 10:31:38 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:port uuid="4aa4e892-0f74-44af-a97a-794f6e9f9708">
Aug 16 10:31:38 user nova-compute[73067]:           <nova:ip type="fixed" address="10.1.1.233" ipVersion="4"/>
Aug 16 10:31:38 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:port uuid="32592ea8-d95c-4230-bbaf-23bab3d70822">
Aug 16 10:31:38 user nova-compute[73067]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
Aug 16 10:31:38 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:port uuid="615324f2-1462-496f-a2e2-847c99c595cb">
Aug 16 10:31:38 user nova-compute[73067]:           <nova:ip type="fixed" address="10.1.1.113" ipVersion="4"/>
Aug 16 10:31:38 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:port uuid="220a6015-5864-45e5-92f0-f0709163db38">
Aug 16 10:31:38 user nova-compute[73067]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 10:31:38 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:38 user nova-compute[73067]:         <nova:port uuid="059ab46b-9eff-4581-b29d-9858760a64dc">
Aug 16 10:31:38 user nova-compute[73067]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 10:31:38 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:38 user nova-compute[73067]:       </nova:ports>
Aug 16 10:31:38 user nova-compute[73067]:     </nova:instance>
Aug 16 10:31:38 user nova-compute[73067]:   </metadata>
Aug 16 10:31:38 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:31:38 user nova-compute[73067]:     <system>
Aug 16 10:31:38 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:31:38 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:31:38 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:31:38 user nova-compute[73067]:       <entry name="serial">11f1d48e-6575-46e8-87a7-ab9defb8a7d7</entry>
Aug 16 10:31:38 user nova-compute[73067]:       <entry name="uuid">11f1d48e-6575-46e8-87a7-ab9defb8a7d7</entry>
Aug 16 10:31:38 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:31:38 user nova-compute[73067]:     </system>
Aug 16 10:31:38 user nova-compute[73067]:   </sysinfo>
Aug 16 10:31:38 user nova-compute[73067]:   <os>
Aug 16 10:31:38 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:31:38 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:31:38 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:31:38 user nova-compute[73067]:   </os>
Aug 16 10:31:38 user nova-compute[73067]:   <features>
Aug 16 10:31:38 user nova-compute[73067]:     <acpi/>
Aug 16 10:31:38 user nova-compute[73067]:     <apic/>
Aug 16 10:31:38 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:31:38 user nova-compute[73067]:   </features>
Aug 16 10:31:38 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:31:38 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:31:38 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:31:38 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:31:38 user nova-compute[73067]:   </clock>
Aug 16 10:31:38 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:31:38 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:31:38 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:31:38 user nova-compute[73067]:   </cpu>
Aug 16 10:31:38 user nova-compute[73067]:   <devices>
Aug 16 10:31:38 user nova-compute[73067]:     <disk type="file" device="cdrom">
Aug 16 10:31:38 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 10:31:38 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/11f1d48e-6575-46e8-87a7-ab9defb8a7d7/disk.config"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="hda" bus="ide"/>
Aug 16 10:31:38 user nova-compute[73067]:     </disk>
Aug 16 10:31:38 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:31:38 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:31:38 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:       <serial>514d6e94-626c-48d2-9449-7d405704e8c5</serial>
Aug 16 10:31:38 user nova-compute[73067]:     </disk>
Aug 16 10:31:38 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:31:38 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:31:38 user nova-compute[73067]:       <source dev="/dev/sdc"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:       <serial>cba384d4-8b94-40b3-968f-548f9c412cff</serial>
Aug 16 10:31:38 user nova-compute[73067]:     </disk>
Aug 16 10:31:38 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:31:38 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:31:38 user nova-compute[73067]:       <source dev="/dev/sde"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="vdc" bus="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:       <serial>a0821e48-26bb-4b64-b7b0-67159069c8ba</serial>
Aug 16 10:31:38 user nova-compute[73067]:     </disk>
Aug 16 10:31:38 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:38 user nova-compute[73067]:       <mac address="fa:16:3e:53:de:eb"/>
Aug 16 10:31:38 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="tap008c71c2-37"/>
Aug 16 10:31:38 user nova-compute[73067]:     </interface>
Aug 16 10:31:38 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:38 user nova-compute[73067]:       <mac address="fa:16:3e:da:4d:ef"/>
Aug 16 10:31:38 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="tap73e02a1e-45"/>
Aug 16 10:31:38 user nova-compute[73067]:     </interface>
Aug 16 10:31:38 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:38 user nova-compute[73067]:       <mac address="fa:16:3e:8c:28:de"/>
Aug 16 10:31:38 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="tap4aa4e892-0f"/>
Aug 16 10:31:38 user nova-compute[73067]:     </interface>
Aug 16 10:31:38 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:38 user nova-compute[73067]:       <mac address="fa:16:3e:fd:ef:86"/>
Aug 16 10:31:38 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="tap32592ea8-d9"/>
Aug 16 10:31:38 user nova-compute[73067]:     </interface>
Aug 16 10:31:38 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:38 user nova-compute[73067]:       <mac address="fa:16:3e:80:14:da"/>
Aug 16 10:31:38 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="tap615324f2-14"/>
Aug 16 10:31:38 user nova-compute[73067]:     </interface>
Aug 16 10:31:38 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:38 user nova-compute[73067]:       <mac address="fa:16:3e:5d:e4:42"/>
Aug 16 10:31:38 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="tap220a6015-58"/>
Aug 16 10:31:38 user nova-compute[73067]:     </interface>
Aug 16 10:31:38 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:38 user nova-compute[73067]:       <mac address="fa:16:3e:a8:2a:61"/>
Aug 16 10:31:38 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:38 user nova-compute[73067]:       <target dev="tap059ab46b-9e"/>
Aug 16 10:31:38 user nova-compute[73067]:     </interface>
Aug 16 10:31:38 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:31:38 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/11f1d48e-6575-46e8-87a7-ab9defb8a7d7/console.log" append="off"/>
Aug 16 10:31:38 user nova-compute[73067]:     </serial>
Aug 16 10:31:38 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:31:38 user nova-compute[73067]:     <video>
Aug 16 10:31:38 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:38 user nova-compute[73067]:     </video>
Aug 16 10:31:38 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:31:38 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:31:38 user nova-compute[73067]:     </rng>
Aug 16 10:31:38 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:31:38 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:31:38 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:31:38 user nova-compute[73067]:     </memballoon>
Aug 16 10:31:38 user nova-compute[73067]:   </devices>
Aug 16 10:31:38 user nova-compute[73067]: </domain>
Aug 16 10:31:38 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:de:eb,bridge_name='br-int',has_traffic_filtering=True,id=008c71c2-37af-4e5c-bc2a-bdf5d684595f,network=Network(092e531c-7d7e-4849-a96b-ba6a51e3ab21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008c71c2-37') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:de:eb,bridge_name='br-int',has_traffic_filtering=True,id=008c71c2-37af-4e5c-bc2a-bdf5d684595f,network=Network(092e531c-7d7e-4849-a96b-ba6a51e3ab21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008c71c2-37') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap008c71c2-37, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap008c71c2-37, col_values=(('external_ids', {'iface-id': '008c71c2-37af-4e5c-bc2a-bdf5d684595f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:de:eb', 'vm-uuid': '11f1d48e-6575-46e8-87a7-ab9defb8a7d7'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-67fc9f25-697d-40f8-93cc-3a274766619a req-75a92f33-7e56-4880-9de5-4594fc468da7 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Received event network-vif-unplugged-0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-67fc9f25-697d-40f8-93cc-3a274766619a req-75a92f33-7e56-4880-9de5-4594fc468da7 service nova] Acquiring lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-67fc9f25-697d-40f8-93cc-3a274766619a req-75a92f33-7e56-4880-9de5-4594fc468da7 service nova] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-67fc9f25-697d-40f8-93cc-3a274766619a req-75a92f33-7e56-4880-9de5-4594fc468da7 service nova] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-67fc9f25-697d-40f8-93cc-3a274766619a req-75a92f33-7e56-4880-9de5-4594fc468da7 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] No waiting events found dispatching network-vif-unplugged-0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-67fc9f25-697d-40f8-93cc-3a274766619a req-75a92f33-7e56-4880-9de5-4594fc468da7 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Received event network-vif-unplugged-0c460a72-6515-44f6-80d4-5a682c43a834 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: INFO os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:de:eb,bridge_name='br-int',has_traffic_filtering=True,id=008c71c2-37af-4e5c-bc2a-bdf5d684595f,network=Network(092e531c-7d7e-4849-a96b-ba6a51e3ab21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008c71c2-37')
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:4d:ef,bridge_name='br-int',has_traffic_filtering=True,id=73e02a1e-4582-4fd2-b9f7-d4f517272dcc,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73e02a1e-45') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:4d:ef,bridge_name='br-int',has_traffic_filtering=True,id=73e02a1e-4582-4fd2-b9f7-d4f517272dcc,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73e02a1e-45') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73e02a1e-45, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73e02a1e-45, col_values=(('external_ids', {'iface-id': '73e02a1e-4582-4fd2-b9f7-d4f517272dcc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:4d:ef', 'vm-uuid': '11f1d48e-6575-46e8-87a7-ab9defb8a7d7'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: INFO os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:4d:ef,bridge_name='br-int',has_traffic_filtering=True,id=73e02a1e-4582-4fd2-b9f7-d4f517272dcc,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73e02a1e-45')
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:28:de,bridge_name='br-int',has_traffic_filtering=True,id=4aa4e892-0f74-44af-a97a-794f6e9f9708,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4aa4e892-0f') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:28:de,bridge_name='br-int',has_traffic_filtering=True,id=4aa4e892-0f74-44af-a97a-794f6e9f9708,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4aa4e892-0f') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4aa4e892-0f, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4aa4e892-0f, col_values=(('external_ids', {'iface-id': '4aa4e892-0f74-44af-a97a-794f6e9f9708', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:28:de', 'vm-uuid': '11f1d48e-6575-46e8-87a7-ab9defb8a7d7'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:31:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: INFO os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:28:de,bridge_name='br-int',has_traffic_filtering=True,id=4aa4e892-0f74-44af-a97a-794f6e9f9708,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4aa4e892-0f')
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=32592ea8-d95c-4230-bbaf-23bab3d70822,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32592ea8-d9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=32592ea8-d95c-4230-bbaf-23bab3d70822,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32592ea8-d9') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32592ea8-d9, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32592ea8-d9, col_values=(('external_ids', {'iface-id': '32592ea8-d95c-4230-bbaf-23bab3d70822', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:ef:86', 'vm-uuid': '11f1d48e-6575-46e8-87a7-ab9defb8a7d7'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: INFO os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=32592ea8-d95c-4230-bbaf-23bab3d70822,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32592ea8-d9')
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:14:da,bridge_name='br-int',has_traffic_filtering=True,id=615324f2-1462-496f-a2e2-847c99c595cb,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap615324f2-14') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:14:da,bridge_name='br-int',has_traffic_filtering=True,id=615324f2-1462-496f-a2e2-847c99c595cb,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap615324f2-14') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap615324f2-14, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap615324f2-14, col_values=(('external_ids', {'iface-id': '615324f2-1462-496f-a2e2-847c99c595cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:14:da', 'vm-uuid': '11f1d48e-6575-46e8-87a7-ab9defb8a7d7'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: INFO os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:14:da,bridge_name='br-int',has_traffic_filtering=True,id=615324f2-1462-496f-a2e2-847c99c595cb,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap615324f2-14')
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:42,bridge_name='br-int',has_traffic_filtering=True,id=220a6015-5864-45e5-92f0-f0709163db38,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220a6015-58') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:42,bridge_name='br-int',has_traffic_filtering=True,id=220a6015-5864-45e5-92f0-f0709163db38,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220a6015-58') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap220a6015-58, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap220a6015-58, col_values=(('external_ids', {'iface-id': '220a6015-5864-45e5-92f0-f0709163db38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:e4:42', 'vm-uuid': '11f1d48e-6575-46e8-87a7-ab9defb8a7d7'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4l53jlwy/f20828636caa4f2291fccbfa4acc80c2.delta /opt/stack/data/nova/instances/snapshots/tmp4l53jlwy/f20828636caa4f2291fccbfa4acc80c2 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Instance destroyed successfully.
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lazy-loading 'resources' on Instance uuid 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2023417787',display_name='tempest-DeleteServersTestJSON-server-2023417787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2023417787',id=1,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:29:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4317072d4b7f45d5bb9149fd878620c8',ramdisk_id='',reservation_id='r-39vtr0kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-379304192',owner_user_name='tempest-DeleteServersTestJSON-379304192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:29:38Z,user_data=None,user_id='ddc3b33d1210437fbbfcbcd33afa134a',uuid=1d4b626f-b793-4cf2-b6f9-4bd0fb16947f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Converting VIF {"id": "0c460a72-6515-44f6-80d4-5a682c43a834", "address": "fa:16:3e:30:2c:35", "network": {"id": "c979bcb0-b5ad-43ca-a5c3-959a0888dd02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1907248719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4317072d4b7f45d5bb9149fd878620c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c460a72-65", "ovs_interfaceid": "0c460a72-6515-44f6-80d4-5a682c43a834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=0c460a72-6515-44f6-80d4-5a682c43a834,network=Network(c979bcb0-b5ad-43ca-a5c3-959a0888dd02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c460a72-65') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_vif [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=0c460a72-6515-44f6-80d4-5a682c43a834,network=Network(c979bcb0-b5ad-43ca-a5c3-959a0888dd02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c460a72-65') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: INFO os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:42,bridge_name='br-int',has_traffic_filtering=True,id=220a6015-5864-45e5-92f0-f0709163db38,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220a6015-58')
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=059ab46b-9eff-4581-b29d-9858760a64dc,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ab46b-9e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=059ab46b-9eff-4581-b29d-9858760a64dc,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ab46b-9e') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c460a72-65, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:38 user nova-compute[73067]: INFO os_vif [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=0c460a72-6515-44f6-80d4-5a682c43a834,network=Network(c979bcb0-b5ad-43ca-a5c3-959a0888dd02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c460a72-65')
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap059ab46b-9e, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap059ab46b-9e, col_values=(('external_ids', {'iface-id': '059ab46b-9eff-4581-b29d-9858760a64dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:2a:61', 'vm-uuid': '11f1d48e-6575-46e8-87a7-ab9defb8a7d7'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHnKMrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:38 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a23bf6-c5a4-4950-90f4-cce235484020]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0f3c04-812e-4dd6-926d-3759bc169af3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:38 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:38 user nova-compute[73067]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)
Aug 16 10:31:38 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:38 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:38 user nova-compute[73067]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 (non-flash)
Aug 16 10:31:38 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f356455d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0'): ({'sdd'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Removing single pathed devices sdd {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4l53jlwy/f20828636caa4f2291fccbfa4acc80c2.delta /opt/stack/data/nova/instances/snapshots/tmp4l53jlwy/f20828636caa4f2291fccbfa4acc80c2" returned: 0 in 0.333s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Snapshot extracted, beginning image upload
Aug 16 10:31:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:38 user nova-compute[73067]: INFO os_vif [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=059ab46b-9eff-4581-b29d-9858760a64dc,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ab46b-9e')
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab01ffab-c894-4d88-8d09-11599a15706b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b59f24-04a0-4b54-9bc8-e07bd7383a47]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Flushing IO for device /dev/sdd {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:31:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da8e59f-4e2c-463c-a7db-16045dd66723]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] No BDM found with device name hda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] No VIF found with MAC fa:16:3e:53:de:eb, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] No VIF found with MAC fa:16:3e:80:14:da, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:31:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Using config drive
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba4b52b-e034-4382-8b94-6921a85c748e]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[730b5bec-3e1f-4a58-ac94-e7ffdf2776bc]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a816da8-f40f-44ec-a578-d142d29e6290]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0, portal: 172.16.0.220,3260]
Aug 16 10:31:39 user nova-compute[73067]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0, portal: 172.16.0.220,3260] successful.
Aug 16 10:31:39 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe526eb8-102b-4749-aed9-9af2ee149fe0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dff94e-0ba6-4864-9262-f43e76b31dd6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.762s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] <== disconnect_volume: return (763ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:31:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Deleting instance files /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f_del
Aug 16 10:31:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Deletion of /opt/stack/data/nova/instances/1d4b626f-b793-4cf2-b6f9-4bd0fb16947f_del complete
Aug 16 10:31:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Creating config drive at /opt/stack/data/nova/instances/11f1d48e-6575-46e8-87a7-ab9defb8a7d7/disk.config
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11f1d48e-6575-46e8-87a7-ab9defb8a7d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxufi9_is {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:31:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Creating image(s)
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Ensure instance console log exists: /opt/stack/data/nova/instances/a050d0a6-0349-478a-8efc-fc4907ed20da/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Start _get_guest_xml network_info=[{"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cinhKJrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a050d0a6-0349-478a-8efc-fc4907ed20da', 'attached_at': '', 'detached_at': '', 'volume_id': '7f1dc418-28fc-4ebb-a684-1c16442608fe', 'serial': '7f1dc418-28fc-4ebb-a684-1c16442608fe'}, 'delete_on_termination': False, 'attachment_id': '6d95b40d-b03e-4c73-a537-1ac160d08ed1', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGEINuXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a050d0a6-0349-478a-8efc-fc4907ed20da', 'attached_at': '', 'detached_at': '', 'volume_id': 'e54dbc73-fb26-416a-9a71-95d17774f30c', 'serial': 'e54dbc73-fb26-416a-9a71-95d17774f30c'}, 'delete_on_termination': False, 'attachment_id': 'ce8e5ae4-eaa3-4e3c-bb90-9bb642d78bbe', 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saLDdwYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a050d0a6-0349-478a-8efc-fc4907ed20da', 'attached_at': '', 'detached_at': '', 'volume_id': '37891010-9dac-4458-9675-352492b59390', 'serial': '37891010-9dac-4458-9675-352492b59390'}, 'delete_on_termination': False, 'attachment_id': 'f9416898-5400-4661-a053-4942a562e623', 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11f1d48e-6575-46e8-87a7-ab9defb8a7d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxufi9_is" returned: 0 in 0.076s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: INFO nova.compute.manager [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Took 1.99 seconds to destroy the instance on the hypervisor.
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:31:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:31:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cinhKJrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:39 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:39 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:39 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac1b8ac-4335-4ff5-ac7d-597c68bd302a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:31:39 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0306030-8c34-4614-a833-a5339d804bd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe] added
Aug 16 10:31:39 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae29dcd-fc70-4b82-b633-0b313d4a5524]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b5a337-ac26-4fe1-b3c5-f3902a0b5ce1]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cinhKJrO {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cinhKJrO" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[381382f4-e553-448b-821d-570fe2210e52]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cinhKJrO'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bc1444-818a-462f-b163-eddcab525ba5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8b01d1-2732-4628-8ce1-608fc104ba18]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:40 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:40 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:40 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:40 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a257c51-a094-4211-bdde-19f9a39743c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe, portal: 172.16.0.220,3260]
Aug 16 10:31:40 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe, portal: 172.16.0.220,3260] successful.
Aug 16 10:31:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8054ba-3efe-484d-86d8-bc490eb8d283]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c0c343-a7fa-4398-bc70-47a78a48afa0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:40 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:40 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:40 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:31:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:40 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:40 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:40 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:31:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c836f5-f2c3-40c2-8950-81fa5fc7431d]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cinhKJrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-ca9f852e-5fd3-4d38-819c-4afdd497f906 req-0b6a9d47-d910-4873-b5fd-f2e4f3bb9e73 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Received event network-vif-plugged-0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ca9f852e-5fd3-4d38-819c-4afdd497f906 req-0b6a9d47-d910-4873-b5fd-f2e4f3bb9e73 service nova] Acquiring lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ca9f852e-5fd3-4d38-819c-4afdd497f906 req-0b6a9d47-d910-4873-b5fd-f2e4f3bb9e73 service nova] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ca9f852e-5fd3-4d38-819c-4afdd497f906 req-0b6a9d47-d910-4873-b5fd-f2e4f3bb9e73 service nova] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-ca9f852e-5fd3-4d38-819c-4afdd497f906 req-0b6a9d47-d910-4873-b5fd-f2e4f3bb9e73 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] No waiting events found dispatching network-vif-plugged-0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:40 user nova-compute[73067]: WARNING nova.compute.manager [req-ca9f852e-5fd3-4d38-819c-4afdd497f906 req-0b6a9d47-d910-4873-b5fd-f2e4f3bb9e73 service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Received unexpected event network-vif-plugged-0c460a72-6515-44f6-80d4-5a682c43a834 for instance with vm_state active and task_state deleting.
Aug 16 10:31:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-5936b292-bdfa-4235-ac04-e6b149fe7a52 req-895e53f6-75f2-4e25-816f-cbea2e36cb4b service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Received event network-vif-deleted-0c460a72-6515-44f6-80d4-5a682c43a834 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:40 user nova-compute[73067]: INFO nova.compute.manager [req-5936b292-bdfa-4235-ac04-e6b149fe7a52 req-895e53f6-75f2-4e25-816f-cbea2e36cb4b service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Neutron deleted interface 0c460a72-6515-44f6-80d4-5a682c43a834; detaching it from the instance and deleting it from the info cache
Aug 16 10:31:40 user nova-compute[73067]: DEBUG nova.network.neutron [req-5936b292-bdfa-4235-ac04-e6b149fe7a52 req-895e53f6-75f2-4e25-816f-cbea2e36cb4b service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:40 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Took 1.03 seconds to deallocate network for instance.
Aug 16 10:31:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-5936b292-bdfa-4235-ac04-e6b149fe7a52 req-895e53f6-75f2-4e25-816f-cbea2e36cb4b service nova] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Detach interface failed, port_id=0c460a72-6515-44f6-80d4-5a682c43a834, reason: Instance 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26437303530316464', 'path': '/dev/sdd'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437303530316464', 'path': '/dev/sdd'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGEINuXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:41 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e841d9-946a-47f5-a515-dd17aa3f96ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:31:41 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[07225447-60a0-4911-b284-6e3dbd044743]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c] added
Aug 16 10:31:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca72f07-c801-408f-9d83-c54514dc11f9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[47db7e1d-e1a2-4500-a297-5cec29adf62b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jGEINuXU {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jGEINuXU" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2392c48b-228a-4d64-96f7-c2d3b11f990f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jGEINuXU'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b2476e-3b92-4ba8-8a1e-594fd66077d4]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3cf4bc-5199-4c27-beaf-2ca9be20f286]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:31:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:31:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[805fd28c-c76c-4674-8b40-8546233aa099]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c, portal: 172.16.0.220,3260]
Aug 16 10:31:41 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c, portal: 172.16.0.220,3260] successful.
Aug 16 10:31:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-315f2332-362c-46a9-9fd1-20f5c6a1297d req-c8544ec9-63f9-4422-85d7-c3d5942b0cf5 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-315f2332-362c-46a9-9fd1-20f5c6a1297d req-c8544ec9-63f9-4422-85d7-c3d5942b0cf5 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-315f2332-362c-46a9-9fd1-20f5c6a1297d req-c8544ec9-63f9-4422-85d7-c3d5942b0cf5 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-315f2332-362c-46a9-9fd1-20f5c6a1297d req-c8544ec9-63f9-4422-85d7-c3d5942b0cf5 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-315f2332-362c-46a9-9fd1-20f5c6a1297d req-c8544ec9-63f9-4422-85d7-c3d5942b0cf5 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:41 user nova-compute[73067]: WARNING nova.compute.manager [req-315f2332-362c-46a9-9fd1-20f5c6a1297d req-c8544ec9-63f9-4422-85d7-c3d5942b0cf5 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f for instance with vm_state building and task_state spawning.
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c8e5d3-dc68-4859-92b5-50e5a5edef3e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e68412-91bc-41dd-93ac-3761a700a3eb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:31:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:31:41 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:31:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada5e59f-40bc-47ea-8bcd-69ee9d633cc5]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGEINuXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:41 user nova-compute[73067]: INFO nova.compute.manager [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Took 1.16 seconds to detach 1 volumes for instance.
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Snapshot image upload complete
Aug 16 10:31:42 user nova-compute[73067]: INFO nova.compute.manager [None req-c23a1f5f-ff96-44b8-8c33-7f3c13a50aed tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Took 6.72 seconds to snapshot the instance on the hypervisor.
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23365336330323264', 'path': '/dev/sdf'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365336330323264', 'path': '/dev/sdf'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.777s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saLDdwYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:42 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:42 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:31:42 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:31:42 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Deleted allocations for instance 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f
Aug 16 10:31:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-634ca3a0-372f-4d27-b7d9-df57404acf8e req-59b83ca3-954b-43f6-84a1-9327a391cae7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-634ca3a0-372f-4d27-b7d9-df57404acf8e req-59b83ca3-954b-43f6-84a1-9327a391cae7 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-634ca3a0-372f-4d27-b7d9-df57404acf8e req-59b83ca3-954b-43f6-84a1-9327a391cae7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-634ca3a0-372f-4d27-b7d9-df57404acf8e req-59b83ca3-954b-43f6-84a1-9327a391cae7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-634ca3a0-372f-4d27-b7d9-df57404acf8e req-59b83ca3-954b-43f6-84a1-9327a391cae7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:42 user nova-compute[73067]: WARNING nova.compute.manager [req-634ca3a0-372f-4d27-b7d9-df57404acf8e req-59b83ca3-954b-43f6-84a1-9327a391cae7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-32592ea8-d95c-4230-bbaf-23bab3d70822 for instance with vm_state building and task_state spawning.
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d45f589-fb50-47e4-9fc7-6ca8202643e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:31:42 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9e68df-fd90-4b49-88e6-038b2aede101]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390] added
Aug 16 10:31:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbf5fe0-58ed-4b17-ac21-159c0ae31086]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeea0ad-543e-4e9e-bb6a-026887b245d6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saLDdwYB {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e90c02ef-562f-4f76-853f-5340880a2735 tempest-DeleteServersTestJSON-379304192 tempest-DeleteServersTestJSON-379304192-project-member] Lock "1d4b626f-b793-4cf2-b6f9-4bd0fb16947f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.281s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saLDdwYB" returned: 0 in 0.056s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13bc402-5998-4f71-8ace-22020ef6d640]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'saLDdwYB'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9157865-3301-4c3c-a8fe-4f821014ae78]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[30009a0b-102c-4f63-8c71-d536d40ad4ad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:31:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:31:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bf7ccb-ae6a-4ef4-bb7a-779a77b73916]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390, portal: 172.16.0.220,3260]
Aug 16 10:31:43 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390, portal: 172.16.0.220,3260] successful.
Aug 16 10:31:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8330b8-6e24-43de-8348-a4d8b0f8dc01]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[40febe0f-1767-4b25-ba85-96a54790d543]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:31:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:31:43 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:31:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.483s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ea4748-f058-46dd-8561-0f6121269f8c]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saLDdwYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-64479b29-bcd9-4eec-ac29-9e6c8fb736aa req-1021dcd9-ed73-4905-b6b3-ce224f6ac62e service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64479b29-bcd9-4eec-ac29-9e6c8fb736aa req-1021dcd9-ed73-4905-b6b3-ce224f6ac62e service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64479b29-bcd9-4eec-ac29-9e6c8fb736aa req-1021dcd9-ed73-4905-b6b3-ce224f6ac62e service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64479b29-bcd9-4eec-ac29-9e6c8fb736aa req-1021dcd9-ed73-4905-b6b3-ce224f6ac62e service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-64479b29-bcd9-4eec-ac29-9e6c8fb736aa req-1021dcd9-ed73-4905-b6b3-ce224f6ac62e service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:43 user nova-compute[73067]: WARNING nova.compute.manager [req-64479b29-bcd9-4eec-ac29-9e6c8fb736aa req-1021dcd9-ed73-4905-b6b3-ce224f6ac62e service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-059ab46b-9eff-4581-b29d-9858760a64dc for instance with vm_state building and task_state spawning.
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:43 user nova-compute[73067]: WARNING nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f for instance with vm_state building and task_state spawning.
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:43 user nova-compute[73067]: WARNING nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc for instance with vm_state building and task_state spawning.
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:43 user nova-compute[73067]: WARNING nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc for instance with vm_state building and task_state spawning.
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-4aa4e892-0f74-44af-a97a-794f6e9f9708 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-4aa4e892-0f74-44af-a97a-794f6e9f9708 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:43 user nova-compute[73067]: WARNING nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-4aa4e892-0f74-44af-a97a-794f6e9f9708 for instance with vm_state building and task_state spawning.
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-4aa4e892-0f74-44af-a97a-794f6e9f9708 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-4aa4e892-0f74-44af-a97a-794f6e9f9708 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:43 user nova-compute[73067]: WARNING nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-4aa4e892-0f74-44af-a97a-794f6e9f9708 for instance with vm_state building and task_state spawning.
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:43 user nova-compute[73067]: WARNING nova.compute.manager [req-9f90f330-8482-4c3e-b2c2-048d81e6157f req-2fa461ab-52b5-450e-b7e5-3b81ded6859d service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-220a6015-5864-45e5-92f0-f0709163db38 for instance with vm_state building and task_state spawning.
Aug 16 10:31:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] <== connect_volume: return (1524ms) {'type': 'block', 'scsi_wwn': '23165343565333030', 'path': '/dev/sdg'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165343565333030', 'path': '/dev/sdg'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=7af2b562-e0cb-4411-ab63-236edb74c04c,network=Network(e4168c39-12cd-485f-9348-f43705293af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af2b562-e0') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=3fb8bad8-53b7-452c-8887-670c2db92f1f,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fb8bad8-53') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9b:fe,bridge_name='br-int',has_traffic_filtering=True,id=7cdb6fd9-c2d7-47d8-88d3-5e064597b51d,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cdb6fd9-c2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:c8:15,bridge_name='br-int',has_traffic_filtering=True,id=fb1cbdeb-3468-4c81-a757-3b54f92aa510,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1cbdeb-34') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fe03e438-e13b-4b98-bd68-ff3638588926,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe03e438-e1') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=367839d4-788f-4f24-9c3e-9df8ff551c87,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367839d4-78') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:71:10,bridge_name='br-int',has_traffic_filtering=True,id=8dce82be-b2e8-47c2-830c-1040265820b7,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dce82be-b2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lazy-loading 'pci_devices' on Instance uuid a050d0a6-0349-478a-8efc-fc4907ed20da {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:31:44 user nova-compute[73067]:   <uuid>a050d0a6-0349-478a-8efc-fc4907ed20da</uuid>
Aug 16 10:31:44 user nova-compute[73067]:   <name>instance-0000000b</name>
Aug 16 10:31:44 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:31:44 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:31:44 user nova-compute[73067]:   <metadata>
Aug 16 10:31:44 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:31:44 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:31:44 user nova-compute[73067]:       <nova:name>tempest-device-tagging-server-1277027415</nova:name>
Aug 16 10:31:44 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:31:39</nova:creationTime>
Aug 16 10:31:44 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:31:44 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:31:44 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:31:44 user nova-compute[73067]:       <nova:owner>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:user uuid="999535c10b504af48797e8511fdf99c5">tempest-TaggedBootDevicesTest-13980695-project-member</nova:user>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:project uuid="912f3a50bdde41b8ad33424f28d22145">tempest-TaggedBootDevicesTest-13980695</nova:project>
Aug 16 10:31:44 user nova-compute[73067]:       </nova:owner>
Aug 16 10:31:44 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:31:44 user nova-compute[73067]:       <nova:ports>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:port uuid="7af2b562-e0cb-4411-ab63-236edb74c04c">
Aug 16 10:31:44 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 10:31:44 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:port uuid="3fb8bad8-53b7-452c-8887-670c2db92f1f">
Aug 16 10:31:44 user nova-compute[73067]:           <nova:ip type="fixed" address="10.1.1.211" ipVersion="4"/>
Aug 16 10:31:44 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:port uuid="7cdb6fd9-c2d7-47d8-88d3-5e064597b51d">
Aug 16 10:31:44 user nova-compute[73067]:           <nova:ip type="fixed" address="10.1.1.131" ipVersion="4"/>
Aug 16 10:31:44 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:port uuid="fb1cbdeb-3468-4c81-a757-3b54f92aa510">
Aug 16 10:31:44 user nova-compute[73067]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Aug 16 10:31:44 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:port uuid="fe03e438-e13b-4b98-bd68-ff3638588926">
Aug 16 10:31:44 user nova-compute[73067]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Aug 16 10:31:44 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:port uuid="367839d4-788f-4f24-9c3e-9df8ff551c87">
Aug 16 10:31:44 user nova-compute[73067]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 10:31:44 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:44 user nova-compute[73067]:         <nova:port uuid="8dce82be-b2e8-47c2-830c-1040265820b7">
Aug 16 10:31:44 user nova-compute[73067]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 10:31:44 user nova-compute[73067]:         </nova:port>
Aug 16 10:31:44 user nova-compute[73067]:       </nova:ports>
Aug 16 10:31:44 user nova-compute[73067]:     </nova:instance>
Aug 16 10:31:44 user nova-compute[73067]:   </metadata>
Aug 16 10:31:44 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:31:44 user nova-compute[73067]:     <system>
Aug 16 10:31:44 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:31:44 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:31:44 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:31:44 user nova-compute[73067]:       <entry name="serial">a050d0a6-0349-478a-8efc-fc4907ed20da</entry>
Aug 16 10:31:44 user nova-compute[73067]:       <entry name="uuid">a050d0a6-0349-478a-8efc-fc4907ed20da</entry>
Aug 16 10:31:44 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:31:44 user nova-compute[73067]:     </system>
Aug 16 10:31:44 user nova-compute[73067]:   </sysinfo>
Aug 16 10:31:44 user nova-compute[73067]:   <os>
Aug 16 10:31:44 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:31:44 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:31:44 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:31:44 user nova-compute[73067]:   </os>
Aug 16 10:31:44 user nova-compute[73067]:   <features>
Aug 16 10:31:44 user nova-compute[73067]:     <acpi/>
Aug 16 10:31:44 user nova-compute[73067]:     <apic/>
Aug 16 10:31:44 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:31:44 user nova-compute[73067]:   </features>
Aug 16 10:31:44 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:31:44 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:31:44 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:31:44 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:31:44 user nova-compute[73067]:   </clock>
Aug 16 10:31:44 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:31:44 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:31:44 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:31:44 user nova-compute[73067]:   </cpu>
Aug 16 10:31:44 user nova-compute[73067]:   <devices>
Aug 16 10:31:44 user nova-compute[73067]:     <disk type="file" device="cdrom">
Aug 16 10:31:44 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 10:31:44 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/a050d0a6-0349-478a-8efc-fc4907ed20da/disk.config"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="hda" bus="ide"/>
Aug 16 10:31:44 user nova-compute[73067]:     </disk>
Aug 16 10:31:44 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:31:44 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:31:44 user nova-compute[73067]:       <source dev="/dev/sdd"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:       <serial>7f1dc418-28fc-4ebb-a684-1c16442608fe</serial>
Aug 16 10:31:44 user nova-compute[73067]:     </disk>
Aug 16 10:31:44 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:31:44 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:31:44 user nova-compute[73067]:       <source dev="/dev/sdf"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:       <serial>e54dbc73-fb26-416a-9a71-95d17774f30c</serial>
Aug 16 10:31:44 user nova-compute[73067]:     </disk>
Aug 16 10:31:44 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:31:44 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:31:44 user nova-compute[73067]:       <source dev="/dev/sdg"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="vdc" bus="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:       <serial>37891010-9dac-4458-9675-352492b59390</serial>
Aug 16 10:31:44 user nova-compute[73067]:     </disk>
Aug 16 10:31:44 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:44 user nova-compute[73067]:       <mac address="fa:16:3e:a8:ea:da"/>
Aug 16 10:31:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="tap7af2b562-e0"/>
Aug 16 10:31:44 user nova-compute[73067]:     </interface>
Aug 16 10:31:44 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:44 user nova-compute[73067]:       <mac address="fa:16:3e:7d:bd:15"/>
Aug 16 10:31:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="tap3fb8bad8-53"/>
Aug 16 10:31:44 user nova-compute[73067]:     </interface>
Aug 16 10:31:44 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:44 user nova-compute[73067]:       <mac address="fa:16:3e:7b:9b:fe"/>
Aug 16 10:31:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="tap7cdb6fd9-c2"/>
Aug 16 10:31:44 user nova-compute[73067]:     </interface>
Aug 16 10:31:44 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:44 user nova-compute[73067]:       <mac address="fa:16:3e:02:c8:15"/>
Aug 16 10:31:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="tapfb1cbdeb-34"/>
Aug 16 10:31:44 user nova-compute[73067]:     </interface>
Aug 16 10:31:44 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:44 user nova-compute[73067]:       <mac address="fa:16:3e:7a:c4:07"/>
Aug 16 10:31:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="tapfe03e438-e1"/>
Aug 16 10:31:44 user nova-compute[73067]:     </interface>
Aug 16 10:31:44 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:44 user nova-compute[73067]:       <mac address="fa:16:3e:51:d7:c9"/>
Aug 16 10:31:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="tap367839d4-78"/>
Aug 16 10:31:44 user nova-compute[73067]:     </interface>
Aug 16 10:31:44 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:31:44 user nova-compute[73067]:       <mac address="fa:16:3e:de:71:10"/>
Aug 16 10:31:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:31:44 user nova-compute[73067]:       <target dev="tap8dce82be-b2"/>
Aug 16 10:31:44 user nova-compute[73067]:     </interface>
Aug 16 10:31:44 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:31:44 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/a050d0a6-0349-478a-8efc-fc4907ed20da/console.log" append="off"/>
Aug 16 10:31:44 user nova-compute[73067]:     </serial>
Aug 16 10:31:44 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:31:44 user nova-compute[73067]:     <video>
Aug 16 10:31:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:31:44 user nova-compute[73067]:     </video>
Aug 16 10:31:44 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:31:44 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:31:44 user nova-compute[73067]:     </rng>
Aug 16 10:31:44 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:31:44 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:31:44 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:31:44 user nova-compute[73067]:     </memballoon>
Aug 16 10:31:44 user nova-compute[73067]:   </devices>
Aug 16 10:31:44 user nova-compute[73067]: </domain>
Aug 16 10:31:44 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=7af2b562-e0cb-4411-ab63-236edb74c04c,network=Network(e4168c39-12cd-485f-9348-f43705293af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af2b562-e0') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=7af2b562-e0cb-4411-ab63-236edb74c04c,network=Network(e4168c39-12cd-485f-9348-f43705293af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af2b562-e0') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7af2b562-e0, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7af2b562-e0, col_values=(('external_ids', {'iface-id': '7af2b562-e0cb-4411-ab63-236edb74c04c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:ea:da', 'vm-uuid': 'a050d0a6-0349-478a-8efc-fc4907ed20da'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: INFO os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=7af2b562-e0cb-4411-ab63-236edb74c04c,network=Network(e4168c39-12cd-485f-9348-f43705293af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af2b562-e0')
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=3fb8bad8-53b7-452c-8887-670c2db92f1f,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fb8bad8-53') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=3fb8bad8-53b7-452c-8887-670c2db92f1f,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fb8bad8-53') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fb8bad8-53, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fb8bad8-53, col_values=(('external_ids', {'iface-id': '3fb8bad8-53b7-452c-8887-670c2db92f1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:bd:15', 'vm-uuid': 'a050d0a6-0349-478a-8efc-fc4907ed20da'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: INFO os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=3fb8bad8-53b7-452c-8887-670c2db92f1f,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fb8bad8-53')
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9b:fe,bridge_name='br-int',has_traffic_filtering=True,id=7cdb6fd9-c2d7-47d8-88d3-5e064597b51d,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cdb6fd9-c2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9b:fe,bridge_name='br-int',has_traffic_filtering=True,id=7cdb6fd9-c2d7-47d8-88d3-5e064597b51d,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cdb6fd9-c2') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cdb6fd9-c2, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cdb6fd9-c2, col_values=(('external_ids', {'iface-id': '7cdb6fd9-c2d7-47d8-88d3-5e064597b51d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:9b:fe', 'vm-uuid': 'a050d0a6-0349-478a-8efc-fc4907ed20da'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: INFO os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9b:fe,bridge_name='br-int',has_traffic_filtering=True,id=7cdb6fd9-c2d7-47d8-88d3-5e064597b51d,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cdb6fd9-c2')
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:c8:15,bridge_name='br-int',has_traffic_filtering=True,id=fb1cbdeb-3468-4c81-a757-3b54f92aa510,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1cbdeb-34') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:c8:15,bridge_name='br-int',has_traffic_filtering=True,id=fb1cbdeb-3468-4c81-a757-3b54f92aa510,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1cbdeb-34') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb1cbdeb-34, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb1cbdeb-34, col_values=(('external_ids', {'iface-id': 'fb1cbdeb-3468-4c81-a757-3b54f92aa510', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:c8:15', 'vm-uuid': 'a050d0a6-0349-478a-8efc-fc4907ed20da'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: INFO os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:c8:15,bridge_name='br-int',has_traffic_filtering=True,id=fb1cbdeb-3468-4c81-a757-3b54f92aa510,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1cbdeb-34')
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fe03e438-e13b-4b98-bd68-ff3638588926,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe03e438-e1') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fe03e438-e13b-4b98-bd68-ff3638588926,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe03e438-e1') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe03e438-e1, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe03e438-e1, col_values=(('external_ids', {'iface-id': 'fe03e438-e13b-4b98-bd68-ff3638588926', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:c4:07', 'vm-uuid': 'a050d0a6-0349-478a-8efc-fc4907ed20da'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: INFO os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fe03e438-e13b-4b98-bd68-ff3638588926,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe03e438-e1')
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=367839d4-788f-4f24-9c3e-9df8ff551c87,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367839d4-78') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=367839d4-788f-4f24-9c3e-9df8ff551c87,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367839d4-78') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap367839d4-78, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap367839d4-78, col_values=(('external_ids', {'iface-id': '367839d4-788f-4f24-9c3e-9df8ff551c87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:d7:c9', 'vm-uuid': 'a050d0a6-0349-478a-8efc-fc4907ed20da'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: INFO os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=367839d4-788f-4f24-9c3e-9df8ff551c87,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367839d4-78')
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:71:10,bridge_name='br-int',has_traffic_filtering=True,id=8dce82be-b2e8-47c2-830c-1040265820b7,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dce82be-b2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:71:10,bridge_name='br-int',has_traffic_filtering=True,id=8dce82be-b2e8-47c2-830c-1040265820b7,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dce82be-b2') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8dce82be-b2, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8dce82be-b2, col_values=(('external_ids', {'iface-id': '8dce82be-b2e8-47c2-830c-1040265820b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:71:10', 'vm-uuid': 'a050d0a6-0349-478a-8efc-fc4907ed20da'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:44 user nova-compute[73067]: INFO os_vif [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:71:10,bridge_name='br-int',has_traffic_filtering=True,id=8dce82be-b2e8-47c2-830c-1040265820b7,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dce82be-b2')
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:44 user nova-compute[73067]: WARNING nova.compute.manager [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-32592ea8-d95c-4230-bbaf-23bab3d70822 for instance with vm_state building and task_state spawning.
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:44 user nova-compute[73067]: WARNING nova.compute.manager [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-615324f2-1462-496f-a2e2-847c99c595cb for instance with vm_state building and task_state spawning.
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:44 user nova-compute[73067]: WARNING nova.compute.manager [req-647cd016-7a35-4d94-bf5b-40d90d73a39e req-df6ebeec-78a2-4d71-8ac0-540486d1cdf2 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-615324f2-1462-496f-a2e2-847c99c595cb for instance with vm_state building and task_state spawning.
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] No BDM found with device name hda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] No VIF found with MAC fa:16:3e:a8:ea:da, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:31:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] No VIF found with MAC fa:16:3e:7a:c4:07, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:31:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Using config drive
Aug 16 10:31:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:45 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Creating config drive at /opt/stack/data/nova/instances/a050d0a6-0349-478a-8efc-fc4907ed20da/disk.config
Aug 16 10:31:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a050d0a6-0349-478a-8efc-fc4907ed20da/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8rdiqbz8 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a050d0a6-0349-478a-8efc-fc4907ed20da/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8rdiqbz8" returned: 0 in 0.062s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181905.748404, 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:31:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] VM Resumed (Lifecycle Event)
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:31:45 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Instance spawned successfully.
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-a8eb0cf6-b001-4ac6-82ad-0da7a35a64de req-79f211ee-b92d-4c40-a747-2b037bb89dad service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a8eb0cf6-b001-4ac6-82ad-0da7a35a64de req-79f211ee-b92d-4c40-a747-2b037bb89dad service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a8eb0cf6-b001-4ac6-82ad-0da7a35a64de req-79f211ee-b92d-4c40-a747-2b037bb89dad service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a8eb0cf6-b001-4ac6-82ad-0da7a35a64de req-79f211ee-b92d-4c40-a747-2b037bb89dad service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-a8eb0cf6-b001-4ac6-82ad-0da7a35a64de req-79f211ee-b92d-4c40-a747-2b037bb89dad service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:45 user nova-compute[73067]: WARNING nova.compute.manager [req-a8eb0cf6-b001-4ac6-82ad-0da7a35a64de req-79f211ee-b92d-4c40-a747-2b037bb89dad service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-059ab46b-9eff-4581-b29d-9858760a64dc for instance with vm_state building and task_state spawning.
Aug 16 10:31:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181905.7556016, 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:31:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] VM Started (Lifecycle Event)
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-9c1c81d9-b683-468a-ba37-58fc52f66b29 req-5f3ec6c8-93c0-499c-be7d-51904032be55 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9c1c81d9-b683-468a-ba37-58fc52f66b29 req-5f3ec6c8-93c0-499c-be7d-51904032be55 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9c1c81d9-b683-468a-ba37-58fc52f66b29 req-5f3ec6c8-93c0-499c-be7d-51904032be55 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9c1c81d9-b683-468a-ba37-58fc52f66b29 req-5f3ec6c8-93c0-499c-be7d-51904032be55 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-9c1c81d9-b683-468a-ba37-58fc52f66b29 req-5f3ec6c8-93c0-499c-be7d-51904032be55 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:45 user nova-compute[73067]: WARNING nova.compute.manager [req-9c1c81d9-b683-468a-ba37-58fc52f66b29 req-5f3ec6c8-93c0-499c-be7d-51904032be55 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-220a6015-5864-45e5-92f0-f0709163db38 for instance with vm_state building and task_state spawning.
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:31:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:31:45 user nova-compute[73067]: INFO nova.compute.manager [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Took 13.58 seconds to spawn the instance on the hypervisor.
Aug 16 10:31:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:45 user nova-compute[73067]: INFO nova.compute.manager [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Took 51.32 seconds to build instance.
Aug 16 10:31:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b4b2609d-4987-4095-b6ea-3257f8d248ea tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.419s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-f98fc41a-f171-4f2d-8193-5e377b36dce5 req-fb8d62e5-37db-4374-a2ec-6d1210d76b06 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f98fc41a-f171-4f2d-8193-5e377b36dce5 req-fb8d62e5-37db-4374-a2ec-6d1210d76b06 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f98fc41a-f171-4f2d-8193-5e377b36dce5 req-fb8d62e5-37db-4374-a2ec-6d1210d76b06 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f98fc41a-f171-4f2d-8193-5e377b36dce5 req-fb8d62e5-37db-4374-a2ec-6d1210d76b06 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-f98fc41a-f171-4f2d-8193-5e377b36dce5 req-fb8d62e5-37db-4374-a2ec-6d1210d76b06 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:46 user nova-compute[73067]: WARNING nova.compute.manager [req-f98fc41a-f171-4f2d-8193-5e377b36dce5 req-fb8d62e5-37db-4374-a2ec-6d1210d76b06 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-7af2b562-e0cb-4411-ab63-236edb74c04c for instance with vm_state building and task_state spawning.
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:47 user nova-compute[73067]: WARNING nova.compute.manager [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-3fb8bad8-53b7-452c-8887-670c2db92f1f for instance with vm_state building and task_state spawning.
Aug 16 10:31:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:47 user nova-compute[73067]: WARNING nova.compute.manager [req-794a2707-f885-438a-b24c-b8efedf41fec req-4c64c2d4-7356-4cd7-bd7b-32bac73f762b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-3fb8bad8-53b7-452c-8887-670c2db92f1f for instance with vm_state building and task_state spawning.
Aug 16 10:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-ff9467b9-c4e0-4281-8c1a-89e3e34762c4 req-57580ed0-c2ee-4961-9ffc-ef55e6067c05 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff9467b9-c4e0-4281-8c1a-89e3e34762c4 req-57580ed0-c2ee-4961-9ffc-ef55e6067c05 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff9467b9-c4e0-4281-8c1a-89e3e34762c4 req-57580ed0-c2ee-4961-9ffc-ef55e6067c05 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff9467b9-c4e0-4281-8c1a-89e3e34762c4 req-57580ed0-c2ee-4961-9ffc-ef55e6067c05 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-ff9467b9-c4e0-4281-8c1a-89e3e34762c4 req-57580ed0-c2ee-4961-9ffc-ef55e6067c05 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:48 user nova-compute[73067]: WARNING nova.compute.manager [req-ff9467b9-c4e0-4281-8c1a-89e3e34762c4 req-57580ed0-c2ee-4961-9ffc-ef55e6067c05 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-8dce82be-b2e8-47c2-830c-1040265820b7 for instance with vm_state building and task_state spawning.
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:49 user nova-compute[73067]: WARNING nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-7af2b562-e0cb-4411-ab63-236edb74c04c for instance with vm_state building and task_state spawning.
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:49 user nova-compute[73067]: WARNING nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d for instance with vm_state building and task_state spawning.
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:49 user nova-compute[73067]: WARNING nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d for instance with vm_state building and task_state spawning.
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:49 user nova-compute[73067]: WARNING nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 for instance with vm_state building and task_state spawning.
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:49 user nova-compute[73067]: WARNING nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 for instance with vm_state building and task_state spawning.
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:49 user nova-compute[73067]: WARNING nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-fe03e438-e13b-4b98-bd68-ff3638588926 for instance with vm_state building and task_state spawning.
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:49 user nova-compute[73067]: WARNING nova.compute.manager [req-8c16a2b2-fb1e-41a1-917a-72f0dfb21869 req-54e9a17c-6625-487a-81a1-304b8e556df9 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-fe03e438-e13b-4b98-bd68-ff3638588926 for instance with vm_state building and task_state spawning.
Aug 16 10:31:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:49 user nova-compute[73067]: WARNING nova.compute.manager [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-367839d4-788f-4f24-9c3e-9df8ff551c87 for instance with vm_state building and task_state spawning.
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:49 user nova-compute[73067]: WARNING nova.compute.manager [req-d2297e8e-089d-4bf5-afdb-f42dc07d9250 req-7f87fcbc-e0f9-4116-ab73-9af85b8fddcd service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-367839d4-788f-4f24-9c3e-9df8ff551c87 for instance with vm_state building and task_state spawning.
Aug 16 10:31:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-e732ac54-d640-4f57-a807-51029fa8167c req-cd551050-e8c1-4b0c-ad13-d5d63cb169f3 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e732ac54-d640-4f57-a807-51029fa8167c req-cd551050-e8c1-4b0c-ad13-d5d63cb169f3 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e732ac54-d640-4f57-a807-51029fa8167c req-cd551050-e8c1-4b0c-ad13-d5d63cb169f3 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e732ac54-d640-4f57-a807-51029fa8167c req-cd551050-e8c1-4b0c-ad13-d5d63cb169f3 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-e732ac54-d640-4f57-a807-51029fa8167c req-cd551050-e8c1-4b0c-ad13-d5d63cb169f3 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:31:51 user nova-compute[73067]: WARNING nova.compute.manager [req-e732ac54-d640-4f57-a807-51029fa8167c req-cd551050-e8c1-4b0c-ad13-d5d63cb169f3 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-8dce82be-b2e8-47c2-830c-1040265820b7 for instance with vm_state building and task_state spawning.
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-f5e4b0a3-914b-4862-a505-fad38ac6d251 req-1dede89c-a5b8-406b-896c-8472efc23fbc service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received event network-changed-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-f5e4b0a3-914b-4862-a505-fad38ac6d251 req-1dede89c-a5b8-406b-896c-8472efc23fbc service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Refreshing instance network info cache due to event network-changed-f62affe8-9713-4377-b35b-b43ca9d09bfe. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f5e4b0a3-914b-4862-a505-fad38ac6d251 req-1dede89c-a5b8-406b-896c-8472efc23fbc service nova] Acquiring lock "refresh_cache-bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f5e4b0a3-914b-4862-a505-fad38ac6d251 req-1dede89c-a5b8-406b-896c-8472efc23fbc service nova] Acquired lock "refresh_cache-bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-f5e4b0a3-914b-4862-a505-fad38ac6d251 req-1dede89c-a5b8-406b-896c-8472efc23fbc service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Refreshing network info cache for port f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181911.4082096, a050d0a6-0349-478a-8efc-fc4907ed20da => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:31:51 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] VM Resumed (Lifecycle Event)
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:31:51 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Instance spawned successfully.
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:31:51 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181911.4105089, a050d0a6-0349-478a-8efc-fc4907ed20da => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:31:51 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] VM Started (Lifecycle Event)
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:31:51 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-f5e4b0a3-914b-4862-a505-fad38ac6d251 req-1dede89c-a5b8-406b-896c-8472efc23fbc service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Updated VIF entry in instance network info cache for port f62affe8-9713-4377-b35b-b43ca9d09bfe. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-f5e4b0a3-914b-4862-a505-fad38ac6d251 req-1dede89c-a5b8-406b-896c-8472efc23fbc service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Updating instance_info_cache with network_info: [{"id": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "address": "fa:16:3e:df:ca:f4", "network": {"id": "b1a0d1c6-2561-40ab-9e22-0987023a848d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-173580811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea4e2f19ebc042ddaaa3f7a410ccf10b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62affe8-97", "ovs_interfaceid": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:51 user nova-compute[73067]: INFO nova.compute.manager [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Took 11.89 seconds to spawn the instance on the hypervisor.
Aug 16 10:31:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f5e4b0a3-914b-4862-a505-fad38ac6d251 req-1dede89c-a5b8-406b-896c-8472efc23fbc service nova] Releasing lock "refresh_cache-bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:51 user nova-compute[73067]: INFO nova.compute.manager [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Took 48.92 seconds to build instance.
Aug 16 10:31:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec7eda5e-1270-4d90-8d7a-4decf59a188a tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.036s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-28f78ac8-27bc-4151-83c8-2651b62bbe97 req-34e057ed-8d09-4f71-92cb-fd28e78a8cf5 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received event network-changed-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-28f78ac8-27bc-4151-83c8-2651b62bbe97 req-34e057ed-8d09-4f71-92cb-fd28e78a8cf5 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Refreshing instance network info cache due to event network-changed-8775245b-73ca-43f0-b4cd-170134560df7. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28f78ac8-27bc-4151-83c8-2651b62bbe97 req-34e057ed-8d09-4f71-92cb-fd28e78a8cf5 service nova] Acquiring lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28f78ac8-27bc-4151-83c8-2651b62bbe97 req-34e057ed-8d09-4f71-92cb-fd28e78a8cf5 service nova] Acquired lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:52 user nova-compute[73067]: DEBUG nova.network.neutron [req-28f78ac8-27bc-4151-83c8-2651b62bbe97 req-34e057ed-8d09-4f71-92cb-fd28e78a8cf5 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Refreshing network info cache for port 8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:53 user nova-compute[73067]: DEBUG nova.network.neutron [req-28f78ac8-27bc-4151-83c8-2651b62bbe97 req-34e057ed-8d09-4f71-92cb-fd28e78a8cf5 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Updated VIF entry in instance network info cache for port 8775245b-73ca-43f0-b4cd-170134560df7. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:53 user nova-compute[73067]: DEBUG nova.network.neutron [req-28f78ac8-27bc-4151-83c8-2651b62bbe97 req-34e057ed-8d09-4f71-92cb-fd28e78a8cf5 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Updating instance_info_cache with network_info: [{"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28f78ac8-27bc-4151-83c8-2651b62bbe97 req-34e057ed-8d09-4f71-92cb-fd28e78a8cf5 service nova] Releasing lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:53 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692181898.603714, 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:31:53 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] VM Stopped (Lifecycle Event)
Aug 16 10:31:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1fc09e0c-c3e0-4064-8032-c6e12dedde2f None None] [instance: 1d4b626f-b793-4cf2-b6f9-4bd0fb16947f] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:31:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG nova.objects.instance [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lazy-loading 'flavor' on Instance uuid bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:55 user nova-compute[73067]: INFO nova.compute.manager [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Attaching volume 133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 to /dev/sdc
Aug 16 10:31:55 user nova-compute[73067]: DEBUG os_brick.utils [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbc2983-9778-4f55-93d4-96d03b1b5e2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.070s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab191551-58e0-4b13-8ee3-771d1745cd9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[092765c4-b5cb-42ec-9775-2f701fba2e06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a56218-eab1-49e2-bf8c-e5cf16f185e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:55 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:31:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e83872a-8d4c-49a9-a79c-47742cbc8b48]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG os_brick.utils [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:55 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Updating existing volume attachment record: 3b48fdc6-d880-4136-80ce-224a8196accf {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lazy-loading 'flavor' on Instance uuid cca10fa3-1289-4ee9-b1d8-fe37afc92960 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:57 user nova-compute[73067]: INFO nova.compute.manager [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Attaching volume c6648668-bbe0-4b22-92cd-395395e2d00e to /dev/vdb
Aug 16 10:31:57 user nova-compute[73067]: DEBUG os_brick.utils [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4376a825-39eb-4ded-82a1-01b3274c9fb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a123fbc-75e6-404d-8824-5038fe5970b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7066415d-7df4-44d5-b5e1-396f7da86b11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d370e1-4a5a-4cb2-8910-edf9a3a6c3c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:58 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:31:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef891df-a725-45cc-a90b-e84b381eb00a]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG os_brick.utils [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Updating existing volume attachment record: 065cadfd-7434-4373-895e-ccaeff4e4b6c {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-59fafe07-1402-49cf-94a2-89e3adcf90df req-3dd26e1f-c016-466d-b0f3-e7ca776909df service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received event network-changed-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-59fafe07-1402-49cf-94a2-89e3adcf90df req-3dd26e1f-c016-466d-b0f3-e7ca776909df service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Refreshing instance network info cache due to event network-changed-32c89e72-0827-416a-b000-48ae3fcef088. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-59fafe07-1402-49cf-94a2-89e3adcf90df req-3dd26e1f-c016-466d-b0f3-e7ca776909df service nova] Acquiring lock "refresh_cache-6b5d4dbc-c660-4b40-81cd-871dfcaa9130" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-59fafe07-1402-49cf-94a2-89e3adcf90df req-3dd26e1f-c016-466d-b0f3-e7ca776909df service nova] Acquired lock "refresh_cache-6b5d4dbc-c660-4b40-81cd-871dfcaa9130" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:31:58 user nova-compute[73067]: DEBUG nova.network.neutron [req-59fafe07-1402-49cf-94a2-89e3adcf90df req-3dd26e1f-c016-466d-b0f3-e7ca776909df service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Refreshing network info cache for port 32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Acquiring lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lazy-loading 'flavor' on Instance uuid 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Acquiring lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:31:59 user nova-compute[73067]: INFO nova.compute.manager [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Attaching volume 859a3108-e017-4c63-9f9e-7d432ce2ff28 to /dev/vdb
Aug 16 10:31:59 user nova-compute[73067]: DEBUG os_brick.utils [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1516d6df-b643-4003-803f-c4c1dc425160]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbae7f3-02b1-475c-b442-4ee162681d2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ea4afb-a6fa-43ce-a684-6af3a10ce01c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cc9fd9-c5d5-41a7-86f5-f34118a4f2c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG nova.network.neutron [req-59fafe07-1402-49cf-94a2-89e3adcf90df req-3dd26e1f-c016-466d-b0f3-e7ca776909df service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Updated VIF entry in instance network info cache for port 32c89e72-0827-416a-b000-48ae3fcef088. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG nova.network.neutron [req-59fafe07-1402-49cf-94a2-89e3adcf90df req-3dd26e1f-c016-466d-b0f3-e7ca776909df service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Updating instance_info_cache with network_info: [{"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-59fafe07-1402-49cf-94a2-89e3adcf90df req-3dd26e1f-c016-466d-b0f3-e7ca776909df service nova] Releasing lock "refresh_cache-6b5d4dbc-c660-4b40-81cd-871dfcaa9130" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:31:59 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:31:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d63fbf9-01b6-4a0e-8249-ee9b19b30989]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG os_brick.utils [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Updating existing volume attachment record: 02bbe217-c6fa-4ff7-8ebc-2e4b9c0947e3 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:31:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-661b070b-76b6-4281-888d-cc12ad5db8eb req-61f8cfb7-34c8-43a9-8f79-93a456816491 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-changed-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-661b070b-76b6-4281-888d-cc12ad5db8eb req-61f8cfb7-34c8-43a9-8f79-93a456816491 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Refreshing instance network info cache due to event network-changed-185f299d-2471-4692-9ead-a478e312f02e. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-661b070b-76b6-4281-888d-cc12ad5db8eb req-61f8cfb7-34c8-43a9-8f79-93a456816491 service nova] Acquiring lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-661b070b-76b6-4281-888d-cc12ad5db8eb req-61f8cfb7-34c8-43a9-8f79-93a456816491 service nova] Acquired lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG nova.network.neutron [req-661b070b-76b6-4281-888d-cc12ad5db8eb req-61f8cfb7-34c8-43a9-8f79-93a456816491 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Refreshing network info cache for port 185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "interface-65299891-9731-4b3b-b23e-85813d45eb58-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "interface-65299891-9731-4b3b-b23e-85813d45eb58-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG nova.objects.instance [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lazy-loading 'flavor' on Instance uuid 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG nova.network.neutron [req-661b070b-76b6-4281-888d-cc12ad5db8eb req-61f8cfb7-34c8-43a9-8f79-93a456816491 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updated VIF entry in instance network info cache for port 185f299d-2471-4692-9ead-a478e312f02e. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG nova.network.neutron [req-661b070b-76b6-4281-888d-cc12ad5db8eb req-61f8cfb7-34c8-43a9-8f79-93a456816491 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updating instance_info_cache with network_info: [{"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-661b070b-76b6-4281-888d-cc12ad5db8eb req-61f8cfb7-34c8-43a9-8f79-93a456816491 service nova] Releasing lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG nova.objects.instance [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lazy-loading 'pci_requests' on Instance uuid 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:01 user nova-compute[73067]: DEBUG nova.network.neutron [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:32:02 user nova-compute[73067]: DEBUG nova.policy [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77535d32f7044acb9972a0dea8b2d882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc4d3a3d3249259022dc9de8015725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:32:02 user nova-compute[73067]: DEBUG nova.network.neutron [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Successfully created port: daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:32:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Successfully updated port: daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:32:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:32:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquired lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:32:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:32:03 user nova-compute[73067]: DEBUG nova.compute.manager [req-7178d00c-db86-4074-8199-77aa4d5aaa7d req-d4c92d81-0ff6-49fb-9122-e860d1185035 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-changed-daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:03 user nova-compute[73067]: DEBUG nova.compute.manager [req-7178d00c-db86-4074-8199-77aa4d5aaa7d req-d4c92d81-0ff6-49fb-9122-e860d1185035 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Refreshing instance network info cache due to event network-changed-daebb0d5-132f-4e96-86a8-1ab84c63f27d. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:32:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7178d00c-db86-4074-8199-77aa4d5aaa7d req-d4c92d81-0ff6-49fb-9122-e860d1185035 service nova] Acquiring lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG nova.network.neutron [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updating instance_info_cache with network_info: [{"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "address": "fa:16:3e:aa:c8:94", "network": {"id": "740038fc-059f-44eb-80eb-3b9c6e80ca8f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1545027352", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebb0d5-13", "ovs_interfaceid": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Releasing lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7178d00c-db86-4074-8199-77aa4d5aaa7d req-d4c92d81-0ff6-49fb-9122-e860d1185035 service nova] Acquired lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-7178d00c-db86-4074-8199-77aa4d5aaa7d req-d4c92d81-0ff6-49fb-9122-e860d1185035 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Refreshing network info cache for port daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-549440583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-549440583',id=8,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/ET4f+GadAJ2XEk1G0bW3MJhSK9fZRqno/3i6IGeLmLpNdtSstzLjv1zvrKcBm/cTzruDBnMijgSTFRsgfXO1gSW064pzF0QTVeNoDA8Zd2epUz5KDmPX2yAUQRp8fNw==',key_name='tempest-keypair-1652680034',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78fc4d3a3d3249259022dc9de8015725',ramdisk_id='',reservation_id='r-sc8f08j5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-632372241',owner_user_name='tempest-TaggedAttachmentsTest-632372241-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77535d32f7044acb9972a0dea8b2d882',uuid=65299891-9731-4b3b-b23e-85813d45eb58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "address": "fa:16:3e:aa:c8:94", "network": {"id": "740038fc-059f-44eb-80eb-3b9c6e80ca8f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1545027352", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebb0d5-13", "ovs_interfaceid": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converting VIF {"id": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "address": "fa:16:3e:aa:c8:94", "network": {"id": "740038fc-059f-44eb-80eb-3b9c6e80ca8f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1545027352", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebb0d5-13", "ovs_interfaceid": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c8:94,bridge_name='br-int',has_traffic_filtering=True,id=daebb0d5-132f-4e96-86a8-1ab84c63f27d,network=Network(740038fc-059f-44eb-80eb-3b9c6e80ca8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebb0d5-13') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG os_vif [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c8:94,bridge_name='br-int',has_traffic_filtering=True,id=daebb0d5-132f-4e96-86a8-1ab84c63f27d,network=Network(740038fc-059f-44eb-80eb-3b9c6e80ca8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebb0d5-13') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaebb0d5-13, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdaebb0d5-13, col_values=(('external_ids', {'iface-id': 'daebb0d5-132f-4e96-86a8-1ab84c63f27d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:c8:94', 'vm-uuid': '65299891-9731-4b3b-b23e-85813d45eb58'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:04 user nova-compute[73067]: INFO os_vif [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c8:94,bridge_name='br-int',has_traffic_filtering=True,id=daebb0d5-132f-4e96-86a8-1ab84c63f27d,network=Network(740038fc-059f-44eb-80eb-3b9c6e80ca8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebb0d5-13')
Aug 16 10:32:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-549440583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-549440583',id=8,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/ET4f+GadAJ2XEk1G0bW3MJhSK9fZRqno/3i6IGeLmLpNdtSstzLjv1zvrKcBm/cTzruDBnMijgSTFRsgfXO1gSW064pzF0QTVeNoDA8Zd2epUz5KDmPX2yAUQRp8fNw==',key_name='tempest-keypair-1652680034',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78fc4d3a3d3249259022dc9de8015725',ramdisk_id='',reservation_id='r-sc8f08j5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-632372241',owner_user_name='tempest-TaggedAttachmentsTest-632372241-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77535d32f7044acb9972a0dea8b2d882',uuid=65299891-9731-4b3b-b23e-85813d45eb58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "address": "fa:16:3e:aa:c8:94", "network": {"id": "740038fc-059f-44eb-80eb-3b9c6e80ca8f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1545027352", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebb0d5-13", "ovs_interfaceid": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converting VIF {"id": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "address": "fa:16:3e:aa:c8:94", "network": {"id": "740038fc-059f-44eb-80eb-3b9c6e80ca8f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1545027352", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebb0d5-13", "ovs_interfaceid": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c8:94,bridge_name='br-int',has_traffic_filtering=True,id=daebb0d5-132f-4e96-86a8-1ab84c63f27d,network=Network(740038fc-059f-44eb-80eb-3b9c6e80ca8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebb0d5-13') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] attach device xml: <interface type="ethernet">
Aug 16 10:32:04 user nova-compute[73067]:   <mac address="fa:16:3e:aa:c8:94"/>
Aug 16 10:32:04 user nova-compute[73067]:   <model type="virtio"/>
Aug 16 10:32:04 user nova-compute[73067]:   <mtu size="1442"/>
Aug 16 10:32:04 user nova-compute[73067]:   <target dev="tapdaebb0d5-13"/>
Aug 16 10:32:04 user nova-compute[73067]: </interface>
Aug 16 10:32:04 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] No BDM found with device name hda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] No VIF found with MAC fa:16:3e:62:c9:de, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG nova.network.neutron [req-7178d00c-db86-4074-8199-77aa4d5aaa7d req-d4c92d81-0ff6-49fb-9122-e860d1185035 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updated VIF entry in instance network info cache for port daebb0d5-132f-4e96-86a8-1ab84c63f27d. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG nova.network.neutron [req-7178d00c-db86-4074-8199-77aa4d5aaa7d req-d4c92d81-0ff6-49fb-9122-e860d1185035 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updating instance_info_cache with network_info: [{"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "address": "fa:16:3e:aa:c8:94", "network": {"id": "740038fc-059f-44eb-80eb-3b9c6e80ca8f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1545027352", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebb0d5-13", "ovs_interfaceid": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:32:05 user nova-compute[73067]:   <nova:package version="0.0.0"/>
Aug 16 10:32:05 user nova-compute[73067]:   <nova:name>tempest-device-tagging-server-549440583</nova:name>
Aug 16 10:32:05 user nova-compute[73067]:   <nova:creationTime>2023-08-16 10:32:05</nova:creationTime>
Aug 16 10:32:05 user nova-compute[73067]:   <nova:flavor name="m1.tiny">
Aug 16 10:32:05 user nova-compute[73067]:     <nova:memory>512</nova:memory>
Aug 16 10:32:05 user nova-compute[73067]:     <nova:disk>1</nova:disk>
Aug 16 10:32:05 user nova-compute[73067]:     <nova:swap>0</nova:swap>
Aug 16 10:32:05 user nova-compute[73067]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:32:05 user nova-compute[73067]:     <nova:vcpus>1</nova:vcpus>
Aug 16 10:32:05 user nova-compute[73067]:   </nova:flavor>
Aug 16 10:32:05 user nova-compute[73067]:   <nova:owner>
Aug 16 10:32:05 user nova-compute[73067]:     <nova:user uuid="77535d32f7044acb9972a0dea8b2d882">tempest-TaggedAttachmentsTest-632372241-project-member</nova:user>
Aug 16 10:32:05 user nova-compute[73067]:     <nova:project uuid="78fc4d3a3d3249259022dc9de8015725">tempest-TaggedAttachmentsTest-632372241</nova:project>
Aug 16 10:32:05 user nova-compute[73067]:   </nova:owner>
Aug 16 10:32:05 user nova-compute[73067]:   <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:32:05 user nova-compute[73067]:   <nova:ports>
Aug 16 10:32:05 user nova-compute[73067]:     <nova:port uuid="185f299d-2471-4692-9ead-a478e312f02e">
Aug 16 10:32:05 user nova-compute[73067]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 10:32:05 user nova-compute[73067]:     </nova:port>
Aug 16 10:32:05 user nova-compute[73067]:     <nova:port uuid="daebb0d5-132f-4e96-86a8-1ab84c63f27d">
Aug 16 10:32:05 user nova-compute[73067]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Aug 16 10:32:05 user nova-compute[73067]:     </nova:port>
Aug 16 10:32:05 user nova-compute[73067]:   </nova:ports>
Aug 16 10:32:05 user nova-compute[73067]: </nova:instance>
Aug 16 10:32:05 user nova-compute[73067]:  {{(pid=73067) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7178d00c-db86-4074-8199-77aa4d5aaa7d req-d4c92d81-0ff6-49fb-9122-e860d1185035 service nova] Releasing lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de83d557-c1b9-448f-9c79-47664d5ef76d tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "interface-65299891-9731-4b3b-b23e-85813d45eb58-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.744s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG nova.compute.manager [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-plugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG nova.compute.manager [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] No waiting events found dispatching network-vif-plugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:05 user nova-compute[73067]: WARNING nova.compute.manager [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received unexpected event network-vif-plugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d for instance with vm_state active and task_state None.
Aug 16 10:32:05 user nova-compute[73067]: DEBUG nova.compute.manager [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-plugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:05 user nova-compute[73067]: DEBUG nova.compute.manager [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] No waiting events found dispatching network-vif-plugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:05 user nova-compute[73067]: WARNING nova.compute.manager [req-2e8edd40-e83e-440f-974b-6663cce8ada0 req-9f5ba2f6-afb9-490d-9923-f4a52e293634 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received unexpected event network-vif-plugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d for instance with vm_state active and task_state None.
Aug 16 10:32:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTCHnrUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:08 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:08 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:08 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd50583-a95a-4351-9623-c6611b08a21c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:32:08 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1123fde0-365c-4fc8-85a1-f5c4badfd50e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020] added
Aug 16 10:32:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e1c3a7-147d-47d3-b328-644f2d197647]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[812dbcde-880e-4284-9ac7-923fc23d7cc9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VTCHnrUe {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VTCHnrUe" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[935309e1-345f-4e5c-aafb-bd15150907e5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VTCHnrUe'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[01907170-23fd-4e31-add0-9381561b1e4d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec9d4be-83a1-4298-b7cf-dced0cec7afe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lazy-loading 'flavor' on Instance uuid 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.158s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --login" returned: 0 in 0.163s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af17d54-93c8-4138-b3ce-6a0b73f780ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020, portal: 172.16.0.220,3260]
Aug 16 10:32:08 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ab5e1-d97d-4eb9-ab13-1afc1c77a5a1]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9141490-df10-4007-8903-8e7117adc162]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:08 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[78874939-ea7a-49c2-8cc3-6a9aabae4ab8]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTCHnrUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:08 user nova-compute[73067]: INFO nova.compute.manager [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Attaching volume edae2cec-f432-4cf6-b579-a13e144e10e6 to /dev/vdb
Aug 16 10:32:09 user nova-compute[73067]: DEBUG os_brick.utils [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc3de3a-53a0-4914-b415-028f4064da28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55a376a-93f6-46e6-b933-e819aabbdc06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a30913-304d-486d-bdab-c1ee2565dfcf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[252f2bf7-9d12-420b-8364-df8bb57abc7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:32:09 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:32:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ad46c-d707-42ca-bcee-78f7f9a6ce6f]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG os_brick.utils [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updating existing volume attachment record: 08eebe81-8aeb-4f4c-ab45-5fa1a3287591 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] <== connect_volume: return (1475ms) {'type': 'block', 'scsi_wwn': '23162326436386133', 'path': '/dev/sdh'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162326436386133', 'path': '/dev/sdh'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:32:10 user nova-compute[73067]: DEBUG nova.objects.instance [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lazy-loading 'flavor' on Instance uuid bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:32:10 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:10 user nova-compute[73067]:   <source dev="/dev/sdh"/>
Aug 16 10:32:10 user nova-compute[73067]:   <target dev="sdc" bus="scsi"/>
Aug 16 10:32:10 user nova-compute[73067]:   <serial>133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020</serial>
Aug 16 10:32:10 user nova-compute[73067]:   <address type="drive" controller="0" unit="2"/>
Aug 16 10:32:10 user nova-compute[73067]: </disk>
Aug 16 10:32:10 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:32:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] No BDM found with device name sda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] No VIF found with MAC fa:16:3e:df:ca:f4, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmsUTArK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:11 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:11 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:11 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3052cf58-e620-49f6-b7be-e8241d0d8a79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:32:11 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff85a55d-6e8a-41a4-a9b9-0557d0546d62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e] added
Aug 16 10:32:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[301998d1-1a66-410b-be8c-2ad83d57c787]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e786d91c-648c-4696-9489-385aa3c152fa]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MmsUTArK {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MmsUTArK" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0056958d-ab53-41d1-8fce-16c713d5dcd0]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MmsUTArK'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c271deb-06c1-4852-a6df-5a40bc58a5e3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f136173-cffd-43be-8479-07fb452ab261]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-02629aa3-f0ea-43eb-8b04-029a9d30a3fd tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.307s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c791fc2-b4d5-4c32-9f06-f89b0b228590]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e, portal: 172.16.0.220,3260]
Aug 16 10:32:11 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad32624a-872f-424d-b15b-043fdd834a93]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce7142d-934f-43e1-b666-8102b1bc6ac2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:32:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[773bef9b-c617-488b-a949-696377f0859d]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:12 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:32:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmsUTArK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26339623561336638', 'path': '/dev/sdi'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339623561336638', 'path': '/dev/sdi'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lazy-loading 'flavor' on Instance uuid cca10fa3-1289-4ee9-b1d8-fe37afc92960 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:32:13 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:13 user nova-compute[73067]:   <source dev="/dev/sdi"/>
Aug 16 10:32:13 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:32:13 user nova-compute[73067]:   <serial>c6648668-bbe0-4b22-92cd-395395e2d00e</serial>
Aug 16 10:32:13 user nova-compute[73067]: </disk>
Aug 16 10:32:13 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] No VIF found with MAC fa:16:3e:01:58:8c, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:32:13 user nova-compute[73067]: INFO nova.compute.manager [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Detaching volume 133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020
Aug 16 10:32:13 user nova-compute[73067]: INFO nova.virt.block_device [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Attempting to driver detach volume 133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 from mountpoint /dev/sdc
Aug 16 10:32:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Attempting to detach device sdc from instance bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:32:13 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:13 user nova-compute[73067]:   <source dev="/dev/sdh"/>
Aug 16 10:32:13 user nova-compute[73067]:   <target dev="sdc" bus="scsi"/>
Aug 16 10:32:13 user nova-compute[73067]:   <serial>133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020</serial>
Aug 16 10:32:13 user nova-compute[73067]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 10:32:13 user nova-compute[73067]: </disk>
Aug 16 10:32:13 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:32:13 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Successfully detached device sdc from instance bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 from the persistent domain config.
Aug 16 10:32:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:32:13 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:13 user nova-compute[73067]:   <source dev="/dev/sdh"/>
Aug 16 10:32:13 user nova-compute[73067]:   <target dev="sdc" bus="scsi"/>
Aug 16 10:32:13 user nova-compute[73067]:   <serial>133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020</serial>
Aug 16 10:32:13 user nova-compute[73067]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 10:32:13 user nova-compute[73067]: </disk>
Aug 16 10:32:13 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:32:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ef7946e4-0ac7-474b-ab74-58b76f248a69 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.047s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXQZxPmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:14 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:14 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:14 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[08118053-8c10-4ff2-be12-3a33815c8aff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:32:14 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe269e1-64fc-453a-b0d2-e2a645063931]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28] added
Aug 16 10:32:14 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58d3a7e-f75d-4d2a-87c1-6249cac6b8c6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7069a06-3adf-4d44-8c26-0b1a0097dbe8]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXQZxPmF {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXQZxPmF" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fd99ea-dbe8-4068-9f84-5a1b6dbab4ff]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lXQZxPmF'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[77adfb6c-e7a9-463f-8feb-85bdf0486739]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b30f475-79c0-457d-8340-e693e2d7013c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692181934.3557043, bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[55259d0f-8be1-4196-ba82-1c968fbc5a77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28, portal: 172.16.0.220,3260]
Aug 16 10:32:14 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:14 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Successfully detached device sdc from instance bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 from the live domain config.
Aug 16 10:32:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTCHnrUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:14 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b4d92f-4038-4165-990d-28bc286474fd]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ae75e4-7d2f-4dda-9be7-88a59d38ead7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:14 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05e770c-cb6e-45de-8963-4fa81c14649e]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXQZxPmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:14 user nova-compute[73067]: INFO nova.compute.manager [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Detaching volume c6648668-bbe0-4b22-92cd-395395e2d00e
Aug 16 10:32:14 user nova-compute[73067]: INFO nova.virt.block_device [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Attempting to driver detach volume c6648668-bbe0-4b22-92cd-395395e2d00e from mountpoint /dev/vdb
Aug 16 10:32:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Attempting to detach device vdb from instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:32:14 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:14 user nova-compute[73067]:   <source dev="/dev/sdi"/>
Aug 16 10:32:14 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:32:14 user nova-compute[73067]:   <serial>c6648668-bbe0-4b22-92cd-395395e2d00e</serial>
Aug 16 10:32:14 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:32:14 user nova-compute[73067]: </disk>
Aug 16 10:32:14 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:32:14 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Successfully detached device vdb from instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 from the persistent domain config.
Aug 16 10:32:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:32:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:32:14 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:14 user nova-compute[73067]:   <source dev="/dev/sdi"/>
Aug 16 10:32:14 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:32:14 user nova-compute[73067]:   <serial>c6648668-bbe0-4b22-92cd-395395e2d00e</serial>
Aug 16 10:32:14 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:32:14 user nova-compute[73067]: </disk>
Aug 16 10:32:14 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692181935.299995, cca10fa3-1289-4ee9-b1d8-fe37afc92960 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:32:15 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Successfully detached device vdb from instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 from the live domain config.
Aug 16 10:32:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmsUTArK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:15 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23135313634323330', 'path': '/dev/sdj'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135313634323330', 'path': '/dev/sdj'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.095s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lazy-loading 'flavor' on Instance uuid 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1b601d-6539-4bbb-8ca4-80c63989ad16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] attach device xml: <disk type="block" device="disk">
Aug 16 10:32:15 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:15 user nova-compute[73067]:   <source dev="/dev/sdj"/>
Aug 16 10:32:15 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:32:15 user nova-compute[73067]:   <serial>859a3108-e017-4c63-9f9e-7d432ce2ff28</serial>
Aug 16 10:32:15 user nova-compute[73067]: </disk>
Aug 16 10:32:15 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[78237092-5453-44c2-8748-ce51c4852814]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35843b5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020'): ({'sdh'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Removing single pathed devices sdh {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c77640c-1ed4-49f0-8500-53ea9372c440]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d7639-256b-4130-bd27-d4a054eeb5e8]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Flushing IO for device /dev/sdh {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f6eafd-baef-421d-84fe-500dc6e8902d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a63e4d4-74cb-47d7-ac4d-89bc8785b216]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] SCSI volumes sdh have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c187062-e494-4fba-93bc-51efb5ef0cfb]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf98871-553e-4371-a59a-52b60f1fc628]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020, portal: 172.16.0.220,3260]
Aug 16 10:32:15 user nova-compute[73067]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133f5b7d-7cb9-4f67-b2e3-2f1ad36cc020 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[edea0e6b-a677-4ea4-a39d-6658535f1c99]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] <== disconnect_volume: return (1397ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.461s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50b022f-ab69-4ce0-9d79-ad521116f841]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d36b18-f1fa-4874-8ad0-0d99720de90d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:15 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35842469e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e'): ({'sdi'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Removing single pathed devices sdi {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f4ff7d-f30c-4172-9151-3314dea4906d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7e0b90-0cc8-42e2-acd8-d9ca2b76b3ec]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Flushing IO for device /dev/sdi {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6e5926-c56f-4910-a8d2-fe49fb5ea464]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] No VIF found with MAC fa:16:3e:5c:82:f8, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b332fd61-7216-4985-bbc4-fc7353d80678]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] SCSI volumes sdi have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a5fd59-0598-4d13-a005-c3b03a23abe5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5599fa85-3d6f-4594-8bdd-5e13287f9efa]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e, portal: 172.16.0.220,3260]
Aug 16 10:32:16 user nova-compute[73067]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9488fe5d-4cbf-40c0-a75d-62411ab77602 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.756s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6648668-bbe0-4b22-92cd-395395e2d00e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3fa73b-dcbf-4712-bc20-52c78e8f2269]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] <== disconnect_volume: return (791ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG nova.objects.instance [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lazy-loading 'flavor' on Instance uuid bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25314c53-345c-4c6d-95d2-6f52520461e6 tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b43fd2e5-3f9c-4d33-92f6-ca2c77e2a4f2 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] volume_snapshot_create: create_info: {'snapshot_id': '99afd8be-519a-446b-874a-09dde7b26e60', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73067) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b43fd2e5-3f9c-4d33-92f6-ca2c77e2a4f2 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] snap xml: <domainsnapshot>
Aug 16 10:32:16 user nova-compute[73067]:   <disks>
Aug 16 10:32:16 user nova-compute[73067]:     <disk name="/dev/sdj" snapshot="external" type="file">
Aug 16 10:32:16 user nova-compute[73067]:       <source file="/dev/new_file"/>
Aug 16 10:32:16 user nova-compute[73067]:     </disk>
Aug 16 10:32:16 user nova-compute[73067]:     <disk name="vda" snapshot="no"/>
Aug 16 10:32:16 user nova-compute[73067]:   </disks>
Aug 16 10:32:16 user nova-compute[73067]: </domainsnapshot>
Aug 16 10:32:16 user nova-compute[73067]:  {{(pid=73067) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG nova.objects.instance [None req-b43fd2e5-3f9c-4d33-92f6-ca2c77e2a4f2 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lazy-loading 'system_metadata' on Instance uuid 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:16 user nova-compute[73067]: DEBUG nova.objects.instance [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lazy-loading 'flavor' on Instance uuid cca10fa3-1289-4ee9-b1d8-fe37afc92960 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-b43fd2e5-3f9c-4d33-92f6-ca2c77e2a4f2 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 10:32:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-acfaf330-36e2-42a5-a0f7-9974b2461d8e tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] volume_snapshot_delete: delete_info: {'volume_id': '859a3108-e017-4c63-9f9e-7d432ce2ff28'} {{(pid=73067) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [None req-acfaf330-36e2-42a5-a0f7-9974b2461d8e tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Traceback (most recent call last):
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     if delete_info['type'] != 'qcow2':
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] KeyError: 'type'
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] 
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [None req-b43fd2e5-3f9c-4d33-92f6-ca2c77e2a4f2 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Traceback (most recent call last):
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     rv = execute(f, *args, **kwargs)
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     six.reraise(c, e, tb)
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     raise value
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     rv = meth(*args, **kwargs)
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] 
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [None req-b43fd2e5-3f9c-4d33-92f6-ca2c77e2a4f2 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Traceback (most recent call last):
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     self._volume_snapshot_create(context, instance, guest,
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     rv = execute(f, *args, **kwargs)
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     six.reraise(c, e, tb)
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     raise value
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     rv = meth(*args, **kwargs)
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 10:32:16 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] 
Aug 16 10:32:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4937652e-25c7-4f13-9886-d63aba899f35 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.166s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [None req-b43fd2e5-3f9c-4d33-92f6-ca2c77e2a4f2 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 99afd8be-519a-446b-874a-09dde7b26e60 could not be found.
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     raise value
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver 
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver 
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 99afd8be-519a-446b-874a-09dde7b26e60 could not be found. (HTTP 404) (Request-ID: req-4791b45b-6bfd-4270-ae69-cc9e5351dede)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver 
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver 
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 99afd8be-519a-446b-874a-09dde7b26e60 could not be found.
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver 
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver [None req-acfaf330-36e2-42a5-a0f7-9974b2461d8e tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver 
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver 
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-8e3ad437-503b-4662-aac4-ef5bcaba62fe)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver 
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver 
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 10:32:17 user nova-compute[73067]: ERROR nova.virt.libvirt.driver 
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server [None req-b43fd2e5-3f9c-4d33-92f6-ca2c77e2a4f2 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise value
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server 
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server [None req-acfaf330-36e2-42a5-a0f7-9974b2461d8e tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Exception during message handling: KeyError: 'type'
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 16 10:32:17 user nova-compute[73067]: ERROR oslo_messaging.rpc.server 
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:17 user nova-compute[73067]: INFO nova.compute.manager [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Terminating instance
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Acquiring lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:17 user nova-compute[73067]: INFO nova.compute.manager [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Detaching volume 859a3108-e017-4c63-9f9e-7d432ce2ff28
Aug 16 10:32:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:17 user nova-compute[73067]: INFO nova.virt.block_device [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Attempting to driver detach volume 859a3108-e017-4c63-9f9e-7d432ce2ff28 from mountpoint /dev/vdb
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Attempting to detach device vdb from instance 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 10:32:17 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:17 user nova-compute[73067]:   <source dev="/dev/sdj"/>
Aug 16 10:32:17 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:32:17 user nova-compute[73067]:   <serial>859a3108-e017-4c63-9f9e-7d432ce2ff28</serial>
Aug 16 10:32:17 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:32:17 user nova-compute[73067]: </disk>
Aug 16 10:32:17 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:32:17 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Successfully detached device vdb from instance 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 from the persistent domain config.
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 10:32:17 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:17 user nova-compute[73067]:   <source dev="/dev/sdj"/>
Aug 16 10:32:17 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:32:17 user nova-compute[73067]:   <serial>859a3108-e017-4c63-9f9e-7d432ce2ff28</serial>
Aug 16 10:32:17 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:32:17 user nova-compute[73067]: </disk>
Aug 16 10:32:17 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-d28c3d53-ea85-4bcd-a596-e509aa33c006 req-61c4aa3c-f1e5-4cc5-9bca-8a4d1571d0c1 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received event network-vif-unplugged-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d28c3d53-ea85-4bcd-a596-e509aa33c006 req-61c4aa3c-f1e5-4cc5-9bca-8a4d1571d0c1 service nova] Acquiring lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d28c3d53-ea85-4bcd-a596-e509aa33c006 req-61c4aa3c-f1e5-4cc5-9bca-8a4d1571d0c1 service nova] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d28c3d53-ea85-4bcd-a596-e509aa33c006 req-61c4aa3c-f1e5-4cc5-9bca-8a4d1571d0c1 service nova] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-d28c3d53-ea85-4bcd-a596-e509aa33c006 req-61c4aa3c-f1e5-4cc5-9bca-8a4d1571d0c1 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] No waiting events found dispatching network-vif-unplugged-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-d28c3d53-ea85-4bcd-a596-e509aa33c006 req-61c4aa3c-f1e5-4cc5-9bca-8a4d1571d0c1 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received event network-vif-unplugged-f62affe8-9713-4377-b35b-b43ca9d09bfe for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692181937.8181581, 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:32:17 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Successfully detached device vdb from instance 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 from the live domain config.
Aug 16 10:32:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXQZxPmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:17 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[77830c9c-77e9-4d24-af67-9bf9d395d171]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0841242-52e7-4fce-9bc8-1dc0c3fc1968]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:17 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:17 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:17 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35936e4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28'): ({'sdj'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Removing single pathed devices sdj {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1857a-651c-4cb9-a942-cbc9df6da279]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb41ae9-9f97-418f-a300-7d8b01c47f54]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Flushing IO for device /dev/sdj {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ad0756-227b-44b6-aff2-b5b95366ab0a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:32:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.051s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[108d155c-9212-4622-9930-6e550fc2db99]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] SCSI volumes sdj have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[530cf4ab-0019-4fc8-9507-7a9c45d553c3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c99475a-5ce3-42ae-8b83-4232affb5c4d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28, portal: 172.16.0.220,3260]
Aug 16 10:32:18 user nova-compute[73067]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:18 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859a3108-e017-4c63-9f9e-7d432ce2ff28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e116ce-0b00-4973-a509-3798112d4b9e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] <== disconnect_volume: return (333ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:32:18 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Instance destroyed successfully.
Aug 16 10:32:18 user nova-compute[73067]: DEBUG nova.objects.instance [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lazy-loading 'resources' on Instance uuid bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1503187959',display_name='tempest-AttachSCSIVolumeTestJSON-server-1503187959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1503187959',id=5,image_ref='8385c313-eeac-44d4-94d9-1cb8be8dbdd9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS8CTjyXSCTsOUMjCfogohFecjhviSh/FyMA4HcK5FjYbT8azvVrWMAAxVHGaJcRPq5o/jl+CGjBkqLCio1LyISSvar6+Csxqh/dk1Sr0zuGjey6clICrvWaS8xWMCzVg==',key_name='tempest-keypair-877037551',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:30:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea4e2f19ebc042ddaaa3f7a410ccf10b',ramdisk_id='',reservation_id='r-g91w9kq3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8385c313-eeac-44d4-94d9-1cb8be8dbdd9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1312893955',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1312893955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:30:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99a6a3b874a84a01a4807da2fbab02e6',uuid=bc2b0cc0-5227-4e0d-8823-3bc82bd30e22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "address": "fa:16:3e:df:ca:f4", "network": {"id": "b1a0d1c6-2561-40ab-9e22-0987023a848d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-173580811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea4e2f19ebc042ddaaa3f7a410ccf10b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62affe8-97", "ovs_interfaceid": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Converting VIF {"id": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "address": "fa:16:3e:df:ca:f4", "network": {"id": "b1a0d1c6-2561-40ab-9e22-0987023a848d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-173580811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea4e2f19ebc042ddaaa3f7a410ccf10b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62affe8-97", "ovs_interfaceid": "f62affe8-9713-4377-b35b-b43ca9d09bfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ca:f4,bridge_name='br-int',has_traffic_filtering=True,id=f62affe8-9713-4377-b35b-b43ca9d09bfe,network=Network(b1a0d1c6-2561-40ab-9e22-0987023a848d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62affe8-97') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG os_vif [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ca:f4,bridge_name='br-int',has_traffic_filtering=True,id=f62affe8-9713-4377-b35b-b43ca9d09bfe,network=Network(b1a0d1c6-2561-40ab-9e22-0987023a848d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62affe8-97') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf62affe8-97, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:18 user nova-compute[73067]: INFO os_vif [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ca:f4,bridge_name='br-int',has_traffic_filtering=True,id=f62affe8-9713-4377-b35b-b43ca9d09bfe,network=Network(b1a0d1c6-2561-40ab-9e22-0987023a848d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62affe8-97')
Aug 16 10:32:18 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Deleting instance files /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22_del
Aug 16 10:32:18 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Deletion of /opt/stack/data/nova/instances/bc2b0cc0-5227-4e0d-8823-3bc82bd30e22_del complete
Aug 16 10:32:18 user nova-compute[73067]: INFO nova.compute.manager [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 16 10:32:18 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:32:18 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.objects.instance [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lazy-loading 'flavor' on Instance uuid 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:32:19 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Took 0.88 seconds to deallocate network for instance.
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-767a4d78-1113-40d3-b07d-98c3a52b4cbc req-0170feff-35de-4a8a-b06c-51ddcaad47d5 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received event network-vif-deleted-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:19 user nova-compute[73067]: INFO nova.compute.manager [req-767a4d78-1113-40d3-b07d-98c3a52b4cbc req-0170feff-35de-4a8a-b06c-51ddcaad47d5 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Neutron deleted interface f62affe8-9713-4377-b35b-b43ca9d09bfe; detaching it from the instance and deleting it from the info cache
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.network.neutron [req-767a4d78-1113-40d3-b07d-98c3a52b4cbc req-0170feff-35de-4a8a-b06c-51ddcaad47d5 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-767a4d78-1113-40d3-b07d-98c3a52b4cbc req-0170feff-35de-4a8a-b06c-51ddcaad47d5 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Detach interface failed, port_id=f62affe8-9713-4377-b35b-b43ca9d09bfe, reason: Instance bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3a4775d-d7c1-4b80-a7e6-b1d9c0ddc2a9 tempest-VolumesAssistedSnapshotsTest-1625673212 tempest-VolumesAssistedSnapshotsTest-1625673212-project-admin] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.006s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-08955e02-bd89-4cb6-8be1-d1f1f9b538a0 req-4207e282-a751-42d6-bccd-3c593ca43f88 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received event network-vif-plugged-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-08955e02-bd89-4cb6-8be1-d1f1f9b538a0 req-4207e282-a751-42d6-bccd-3c593ca43f88 service nova] Acquiring lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-08955e02-bd89-4cb6-8be1-d1f1f9b538a0 req-4207e282-a751-42d6-bccd-3c593ca43f88 service nova] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-08955e02-bd89-4cb6-8be1-d1f1f9b538a0 req-4207e282-a751-42d6-bccd-3c593ca43f88 service nova] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-08955e02-bd89-4cb6-8be1-d1f1f9b538a0 req-4207e282-a751-42d6-bccd-3c593ca43f88 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] No waiting events found dispatching network-vif-plugged-f62affe8-9713-4377-b35b-b43ca9d09bfe {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:19 user nova-compute[73067]: WARNING nova.compute.manager [req-08955e02-bd89-4cb6-8be1-d1f1f9b538a0 req-4207e282-a751-42d6-bccd-3c593ca43f88 service nova] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Received unexpected event network-vif-plugged-f62affe8-9713-4377-b35b-b43ca9d09bfe for instance with vm_state deleted and task_state None.
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:19 user nova-compute[73067]: INFO nova.compute.manager [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Terminating instance
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:32:19 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Deleted allocations for instance bc2b0cc0-5227-4e0d-8823-3bc82bd30e22
Aug 16 10:32:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c92c8892-d728-421c-9dce-44a8ed8bda2d tempest-AttachSCSIVolumeTestJSON-1312893955 tempest-AttachSCSIVolumeTestJSON-1312893955-project-member] Lock "bc2b0cc0-5227-4e0d-8823-3bc82bd30e22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.628s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-905ace03-1bde-41b8-82da-5f791d89f1ac req-368397c8-e9f0-40b1-a5cf-34bbdce07006 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Received event network-vif-unplugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-905ace03-1bde-41b8-82da-5f791d89f1ac req-368397c8-e9f0-40b1-a5cf-34bbdce07006 service nova] Acquiring lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-905ace03-1bde-41b8-82da-5f791d89f1ac req-368397c8-e9f0-40b1-a5cf-34bbdce07006 service nova] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-905ace03-1bde-41b8-82da-5f791d89f1ac req-368397c8-e9f0-40b1-a5cf-34bbdce07006 service nova] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-905ace03-1bde-41b8-82da-5f791d89f1ac req-368397c8-e9f0-40b1-a5cf-34bbdce07006 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] No waiting events found dispatching network-vif-unplugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-905ace03-1bde-41b8-82da-5f791d89f1ac req-368397c8-e9f0-40b1-a5cf-34bbdce07006 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Received event network-vif-unplugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:32:20 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Instance destroyed successfully.
Aug 16 10:32:20 user nova-compute[73067]: DEBUG nova.objects.instance [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lazy-loading 'resources' on Instance uuid f765ae8f-01ae-4eaf-a1ec-daaba1c72be1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1540128314',display_name='tempest-VolumesActionsTest-instance-1540128314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1540128314',id=9,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='170bcb24cdf44e63ad5f42259b9c470c',ramdisk_id='',reservation_id='r-g2xyd90l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-811248869',owner_user_name='tempest-VolumesActionsTest-811248869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:30:38Z,user_data=None,user_id='586e0de6f261403fa757b2da4b578f8b',uuid=f765ae8f-01ae-4eaf-a1ec-daaba1c72be1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "address": "fa:16:3e:78:69:68", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108872ff-33", "ovs_interfaceid": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converting VIF {"id": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "address": "fa:16:3e:78:69:68", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108872ff-33", "ovs_interfaceid": "108872ff-3398-4aaf-b9e4-4a190e6c0975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:68,bridge_name='br-int',has_traffic_filtering=True,id=108872ff-3398-4aaf-b9e4-4a190e6c0975,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108872ff-33') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG os_vif [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:68,bridge_name='br-int',has_traffic_filtering=True,id=108872ff-3398-4aaf-b9e4-4a190e6c0975,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108872ff-33') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap108872ff-33, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:20 user nova-compute[73067]: INFO os_vif [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:68,bridge_name='br-int',has_traffic_filtering=True,id=108872ff-3398-4aaf-b9e4-4a190e6c0975,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108872ff-33')
Aug 16 10:32:20 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Deleting instance files /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1_del
Aug 16 10:32:20 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Deletion of /opt/stack/data/nova/instances/f765ae8f-01ae-4eaf-a1ec-daaba1c72be1_del complete
Aug 16 10:32:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:20 user nova-compute[73067]: INFO nova.compute.manager [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 16 10:32:20 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:32:20 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-195833d7-1b14-4cd6-89ce-ad8bb06f1901 req-0d009d34-75b1-4375-afdf-20e3aedaa60f service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Received event network-vif-deleted-108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:21 user nova-compute[73067]: INFO nova.compute.manager [req-195833d7-1b14-4cd6-89ce-ad8bb06f1901 req-0d009d34-75b1-4375-afdf-20e3aedaa60f service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Neutron deleted interface 108872ff-3398-4aaf-b9e4-4a190e6c0975; detaching it from the instance and deleting it from the info cache
Aug 16 10:32:21 user nova-compute[73067]: DEBUG nova.network.neutron [req-195833d7-1b14-4cd6-89ce-ad8bb06f1901 req-0d009d34-75b1-4375-afdf-20e3aedaa60f service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:32:21 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Took 0.47 seconds to deallocate network for instance.
Aug 16 10:32:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-195833d7-1b14-4cd6-89ce-ad8bb06f1901 req-0d009d34-75b1-4375-afdf-20e3aedaa60f service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Detach interface failed, port_id=108872ff-3398-4aaf-b9e4-4a190e6c0975, reason: Instance f765ae8f-01ae-4eaf-a1ec-daaba1c72be1 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCqMxAlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:21 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:21 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:21 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f80062-7ebc-4c38-abe9-45b77cc44ec5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:32:21 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5f6411-b5eb-451a-82e9-621f86debab9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6] added
Aug 16 10:32:21 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b3d30f-e611-4758-ae2c-f9967f571119]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[75058d04-137d-4fab-9663-508bb4cb4e0a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TCqMxAlO {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TCqMxAlO" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09b507e-cae2-4098-a7f4-726bd1b5663c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TCqMxAlO'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11adb78-c78e-4b35-bf1f-5b2634d064eb]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bcc5a0-98e8-4fef-8a22-cde691ef0317]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:21 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:21 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7755119a-1b2d-4403-beb2-1f371889dfa3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6, portal: 172.16.0.220,3260]
Aug 16 10:32:21 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:21 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdff594e-933f-4129-b4ee-42e5d1a0e7d9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Deleted allocations for instance f765ae8f-01ae-4eaf-a1ec-daaba1c72be1
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[663d5e60-2a08-4658-8101-e393e193c5fb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:21 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:21 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:21 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[265b531f-83e8-4cdf-aa27-a6459e1a427b]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCqMxAlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb500637-a3b5-499e-994d-2e69459090ca tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-39bc479f-733b-43a1-80fb-576950aa4b14 req-0b87ab38-a7f7-4e40-9ef4-245ac7c13bc0 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Received event network-vif-plugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-39bc479f-733b-43a1-80fb-576950aa4b14 req-0b87ab38-a7f7-4e40-9ef4-245ac7c13bc0 service nova] Acquiring lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-39bc479f-733b-43a1-80fb-576950aa4b14 req-0b87ab38-a7f7-4e40-9ef4-245ac7c13bc0 service nova] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-39bc479f-733b-43a1-80fb-576950aa4b14 req-0b87ab38-a7f7-4e40-9ef4-245ac7c13bc0 service nova] Lock "f765ae8f-01ae-4eaf-a1ec-daaba1c72be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-39bc479f-733b-43a1-80fb-576950aa4b14 req-0b87ab38-a7f7-4e40-9ef4-245ac7c13bc0 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] No waiting events found dispatching network-vif-plugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:22 user nova-compute[73067]: WARNING nova.compute.manager [req-39bc479f-733b-43a1-80fb-576950aa4b14 req-0b87ab38-a7f7-4e40-9ef4-245ac7c13bc0 service nova] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Received unexpected event network-vif-plugged-108872ff-3398-4aaf-b9e4-4a190e6c0975 for instance with vm_state deleted and task_state None.
Aug 16 10:32:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23866306666623166', 'path': '/dev/sdh'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866306666623166', 'path': '/dev/sdh'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:32:22 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lazy-loading 'flavor' on Instance uuid 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:32:22 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:22 user nova-compute[73067]:   <source dev="/dev/sdh"/>
Aug 16 10:32:22 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:32:22 user nova-compute[73067]:   <serial>edae2cec-f432-4cf6-b579-a13e144e10e6</serial>
Aug 16 10:32:22 user nova-compute[73067]: </disk>
Aug 16 10:32:22 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:32:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] No BDM found with device name hda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:32:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] No VIF found with MAC fa:16:3e:62:c9:de, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:32:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0f811d2d-8313-439c-b4c8-a97129d57521 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.533s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:24 user nova-compute[73067]: INFO nova.compute.manager [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Detaching volume edae2cec-f432-4cf6-b579-a13e144e10e6
Aug 16 10:32:24 user nova-compute[73067]: INFO nova.virt.block_device [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Attempting to driver detach volume edae2cec-f432-4cf6-b579-a13e144e10e6 from mountpoint /dev/vdb
Aug 16 10:32:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Attempting to detach device vdb from instance 65299891-9731-4b3b-b23e-85813d45eb58 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:32:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:32:24 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:24 user nova-compute[73067]:   <source dev="/dev/sdh"/>
Aug 16 10:32:24 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:32:24 user nova-compute[73067]:   <serial>edae2cec-f432-4cf6-b579-a13e144e10e6</serial>
Aug 16 10:32:24 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 10:32:24 user nova-compute[73067]: </disk>
Aug 16 10:32:24 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:32:24 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Successfully detached device vdb from instance 65299891-9731-4b3b-b23e-85813d45eb58 from the persistent domain config.
Aug 16 10:32:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65299891-9731-4b3b-b23e-85813d45eb58 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:32:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:32:24 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:32:24 user nova-compute[73067]:   <source dev="/dev/sdh"/>
Aug 16 10:32:24 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:32:24 user nova-compute[73067]:   <serial>edae2cec-f432-4cf6-b579-a13e144e10e6</serial>
Aug 16 10:32:24 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 10:32:24 user nova-compute[73067]: </disk>
Aug 16 10:32:24 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692181945.4252107, 65299891-9731-4b3b-b23e-85813d45eb58 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:32:25 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Successfully detached device vdb from instance 65299891-9731-4b3b-b23e-85813d45eb58 from the live domain config.
Aug 16 10:32:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCqMxAlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:25 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa408e6-fe38-4af2-8f5f-fc5613a67d62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7e8fba-7cc1-42f7-b64c-4ba0ad3e61d5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:25 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:25 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:25 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f356436ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6'): ({'sdh'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Removing single pathed devices sdh {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c2c8a7-d1be-4e03-b72d-167c08af6c61]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95cace5-5057-4eff-baf4-bb602b9e6c9a]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Flushing IO for device /dev/sdh {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[85db60df-e5ca-4eeb-8cf4-2d124ab7e770]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc06c25-038b-4008-b193-ac35f47fbcf8]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] SCSI volumes sdh have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0a6afb-0bf0-49b1-baff-431aea244581]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3921ca7f-0622-46d5-8fd6-af278551a41c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6, portal: 172.16.0.220,3260]
Aug 16 10:32:25 user nova-compute[73067]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:25 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edae2cec-f432-4cf6-b579-a13e144e10e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a8b48-3c7e-40c2-aa91-0fafc4490395]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] <== disconnect_volume: return (308ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lazy-loading 'flavor' on Instance uuid 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d855aaed-9e06-4f83-9938-d3bdb22796c8 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.693s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "interface-65299891-9731-4b3b-b23e-85813d45eb58-daebb0d5-132f-4e96-86a8-1ab84c63f27d" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "interface-65299891-9731-4b3b-b23e-85813d45eb58-daebb0d5-132f-4e96-86a8-1ab84c63f27d" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.objects.instance [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lazy-loading 'flavor' on Instance uuid 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-549440583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-549440583',id=8,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/ET4f+GadAJ2XEk1G0bW3MJhSK9fZRqno/3i6IGeLmLpNdtSstzLjv1zvrKcBm/cTzruDBnMijgSTFRsgfXO1gSW064pzF0QTVeNoDA8Zd2epUz5KDmPX2yAUQRp8fNw==',key_name='tempest-keypair-1652680034',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78fc4d3a3d3249259022dc9de8015725',ramdisk_id='',reservation_id='r-sc8f08j5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-632372241',owner_user_name='tempest-TaggedAttachmentsTest-632372241-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77535d32f7044acb9972a0dea8b2d882',uuid=65299891-9731-4b3b-b23e-85813d45eb58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "address": "fa:16:3e:aa:c8:94", "network": {"id": "740038fc-059f-44eb-80eb-3b9c6e80ca8f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1545027352", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebb0d5-13", "ovs_interfaceid": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converting VIF {"id": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "address": "fa:16:3e:aa:c8:94", "network": {"id": "740038fc-059f-44eb-80eb-3b9c6e80ca8f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1545027352", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebb0d5-13", "ovs_interfaceid": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c8:94,bridge_name='br-int',has_traffic_filtering=True,id=daebb0d5-132f-4e96-86a8-1ab84c63f27d,network=Network(740038fc-059f-44eb-80eb-3b9c6e80ca8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebb0d5-13') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:aa:c8:94"/><model type="virtio"/><mtu size="1442"/><target dev="tapdaebb0d5-13"/></interface> {{(pid=73067) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:aa:c8:94"/><model type="virtio"/><mtu size="1442"/><target dev="tapdaebb0d5-13"/></interface> {{(pid=73067) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Attempting to detach device tapdaebb0d5-13 from instance 65299891-9731-4b3b-b23e-85813d45eb58 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] detach device xml: <interface type="ethernet">
Aug 16 10:32:27 user nova-compute[73067]:   <mac address="fa:16:3e:aa:c8:94"/>
Aug 16 10:32:27 user nova-compute[73067]:   <model type="virtio"/>
Aug 16 10:32:27 user nova-compute[73067]:   <mtu size="1442"/>
Aug 16 10:32:27 user nova-compute[73067]:   <target dev="tapdaebb0d5-13"/>
Aug 16 10:32:27 user nova-compute[73067]: </interface>
Aug 16 10:32:27 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:aa:c8:94"/><model type="virtio"/><mtu size="1442"/><target dev="tapdaebb0d5-13"/></interface> {{(pid=73067) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:aa:c8:94"/><model type="virtio"/><mtu size="1442"/><target dev="tapdaebb0d5-13"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 16 10:32:27 user nova-compute[73067]:   <name>instance-00000008</name>
Aug 16 10:32:27 user nova-compute[73067]:   <uuid>65299891-9731-4b3b-b23e-85813d45eb58</uuid>
Aug 16 10:32:27 user nova-compute[73067]:   <metadata>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:32:27 user nova-compute[73067]:   <nova:package version="0.0.0"/>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:name>tempest-device-tagging-server-549440583</nova:name>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:creationTime>2023-08-16 10:32:05</nova:creationTime>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:flavor name="m1.tiny">
Aug 16 10:32:27 user nova-compute[73067]:     <nova:memory>512</nova:memory>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:disk>1</nova:disk>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:swap>0</nova:swap>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:vcpus>1</nova:vcpus>
Aug 16 10:32:27 user nova-compute[73067]:   </nova:flavor>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:owner>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:user uuid="77535d32f7044acb9972a0dea8b2d882">tempest-TaggedAttachmentsTest-632372241-project-member</nova:user>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:project uuid="78fc4d3a3d3249259022dc9de8015725">tempest-TaggedAttachmentsTest-632372241</nova:project>
Aug 16 10:32:27 user nova-compute[73067]:   </nova:owner>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:ports>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:port uuid="185f299d-2471-4692-9ead-a478e312f02e">
Aug 16 10:32:27 user nova-compute[73067]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 10:32:27 user nova-compute[73067]:     </nova:port>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:port uuid="daebb0d5-132f-4e96-86a8-1ab84c63f27d">
Aug 16 10:32:27 user nova-compute[73067]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Aug 16 10:32:27 user nova-compute[73067]:     </nova:port>
Aug 16 10:32:27 user nova-compute[73067]:   </nova:ports>
Aug 16 10:32:27 user nova-compute[73067]: </nova:instance>
Aug 16 10:32:27 user nova-compute[73067]:   </metadata>
Aug 16 10:32:27 user nova-compute[73067]:   <memory unit='KiB'>524288</memory>
Aug 16 10:32:27 user nova-compute[73067]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 10:32:27 user nova-compute[73067]:   <vcpu placement='static'>1</vcpu>
Aug 16 10:32:27 user nova-compute[73067]:   <resource>
Aug 16 10:32:27 user nova-compute[73067]:     <partition>/machine</partition>
Aug 16 10:32:27 user nova-compute[73067]:   </resource>
Aug 16 10:32:27 user nova-compute[73067]:   <sysinfo type='smbios'>
Aug 16 10:32:27 user nova-compute[73067]:     <system>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='version'>0.0.0</entry>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='serial'>65299891-9731-4b3b-b23e-85813d45eb58</entry>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='uuid'>65299891-9731-4b3b-b23e-85813d45eb58</entry>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='family'>Virtual Machine</entry>
Aug 16 10:32:27 user nova-compute[73067]:     </system>
Aug 16 10:32:27 user nova-compute[73067]:   </sysinfo>
Aug 16 10:32:27 user nova-compute[73067]:   <os>
Aug 16 10:32:27 user nova-compute[73067]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 10:32:27 user nova-compute[73067]:     <boot dev='hd'/>
Aug 16 10:32:27 user nova-compute[73067]:     <smbios mode='sysinfo'/>
Aug 16 10:32:27 user nova-compute[73067]:   </os>
Aug 16 10:32:27 user nova-compute[73067]:   <features>
Aug 16 10:32:27 user nova-compute[73067]:     <acpi/>
Aug 16 10:32:27 user nova-compute[73067]:     <apic/>
Aug 16 10:32:27 user nova-compute[73067]:     <vmcoreinfo state='on'/>
Aug 16 10:32:27 user nova-compute[73067]:   </features>
Aug 16 10:32:27 user nova-compute[73067]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 10:32:27 user nova-compute[73067]:     <model fallback='forbid'>Nehalem</model>
Aug 16 10:32:27 user nova-compute[73067]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 10:32:27 user nova-compute[73067]:     <feature policy='require' name='vme'/>
Aug 16 10:32:27 user nova-compute[73067]:     <feature policy='require' name='x2apic'/>
Aug 16 10:32:27 user nova-compute[73067]:     <feature policy='require' name='hypervisor'/>
Aug 16 10:32:27 user nova-compute[73067]:   </cpu>
Aug 16 10:32:27 user nova-compute[73067]:   <clock offset='utc'>
Aug 16 10:32:27 user nova-compute[73067]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 10:32:27 user nova-compute[73067]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 10:32:27 user nova-compute[73067]:     <timer name='hpet' present='no'/>
Aug 16 10:32:27 user nova-compute[73067]:   </clock>
Aug 16 10:32:27 user nova-compute[73067]:   <on_poweroff>destroy</on_poweroff>
Aug 16 10:32:27 user nova-compute[73067]:   <on_reboot>restart</on_reboot>
Aug 16 10:32:27 user nova-compute[73067]:   <on_crash>destroy</on_crash>
Aug 16 10:32:27 user nova-compute[73067]:   <devices>
Aug 16 10:32:27 user nova-compute[73067]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 10:32:27 user nova-compute[73067]:     <disk type='file' device='disk'>
Aug 16 10:32:27 user nova-compute[73067]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 10:32:27 user nova-compute[73067]:       <source file='/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk' index='2'/>
Aug 16 10:32:27 user nova-compute[73067]:       <backingStore type='file' index='3'>
Aug 16 10:32:27 user nova-compute[73067]:         <format type='raw'/>
Aug 16 10:32:27 user nova-compute[73067]:         <source file='/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832'/>
Aug 16 10:32:27 user nova-compute[73067]:         <backingStore/>
Aug 16 10:32:27 user nova-compute[73067]:       </backingStore>
Aug 16 10:32:27 user nova-compute[73067]:       <target dev='vda' bus='virtio'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='virtio-disk0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </disk>
Aug 16 10:32:27 user nova-compute[73067]:     <disk type='file' device='cdrom'>
Aug 16 10:32:27 user nova-compute[73067]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 10:32:27 user nova-compute[73067]:       <source file='/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk.config' index='1'/>
Aug 16 10:32:27 user nova-compute[73067]:       <backingStore/>
Aug 16 10:32:27 user nova-compute[73067]:       <target dev='hda' bus='ide'/>
Aug 16 10:32:27 user nova-compute[73067]:       <readonly/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='ide0-0-0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </disk>
Aug 16 10:32:27 user nova-compute[73067]:     <controller type='usb' index='0' model='none'>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='usb'/>
Aug 16 10:32:27 user nova-compute[73067]:     </controller>
Aug 16 10:32:27 user nova-compute[73067]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='pci.0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </controller>
Aug 16 10:32:27 user nova-compute[73067]:     <controller type='ide' index='0'>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='ide'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 10:32:27 user nova-compute[73067]:     </controller>
Aug 16 10:32:27 user nova-compute[73067]:     <interface type='ethernet'>
Aug 16 10:32:27 user nova-compute[73067]:       <mac address='fa:16:3e:62:c9:de'/>
Aug 16 10:32:27 user nova-compute[73067]:       <target dev='tap185f299d-24'/>
Aug 16 10:32:27 user nova-compute[73067]:       <model type='virtio'/>
Aug 16 10:32:27 user nova-compute[73067]:       <mtu size='1442'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='net0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </interface>
Aug 16 10:32:27 user nova-compute[73067]:     <interface type='ethernet'>
Aug 16 10:32:27 user nova-compute[73067]:       <mac address='fa:16:3e:aa:c8:94'/>
Aug 16 10:32:27 user nova-compute[73067]:       <target dev='tapdaebb0d5-13'/>
Aug 16 10:32:27 user nova-compute[73067]:       <model type='virtio'/>
Aug 16 10:32:27 user nova-compute[73067]:       <mtu size='1442'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='net1'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </interface>
Aug 16 10:32:27 user nova-compute[73067]:     <serial type='pty'>
Aug 16 10:32:27 user nova-compute[73067]:       <source path='/dev/pts/7'/>
Aug 16 10:32:27 user nova-compute[73067]:       <log file='/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/console.log' append='off'/>
Aug 16 10:32:27 user nova-compute[73067]:       <target type='isa-serial' port='0'>
Aug 16 10:32:27 user nova-compute[73067]:         <model name='isa-serial'/>
Aug 16 10:32:27 user nova-compute[73067]:       </target>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='serial0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </serial>
Aug 16 10:32:27 user nova-compute[73067]:     <console type='pty' tty='/dev/pts/7'>
Aug 16 10:32:27 user nova-compute[73067]:       <source path='/dev/pts/7'/>
Aug 16 10:32:27 user nova-compute[73067]:       <log file='/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/console.log' append='off'/>
Aug 16 10:32:27 user nova-compute[73067]:       <target type='serial' port='0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='serial0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </console>
Aug 16 10:32:27 user nova-compute[73067]:     <input type='mouse' bus='ps2'>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='input0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </input>
Aug 16 10:32:27 user nova-compute[73067]:     <input type='keyboard' bus='ps2'>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='input1'/>
Aug 16 10:32:27 user nova-compute[73067]:     </input>
Aug 16 10:32:27 user nova-compute[73067]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 16 10:32:27 user nova-compute[73067]:       <listen type='address' address='0.0.0.0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </graphics>
Aug 16 10:32:27 user nova-compute[73067]:     <audio id='1' type='none'/>
Aug 16 10:32:27 user nova-compute[73067]:     <video>
Aug 16 10:32:27 user nova-compute[73067]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='video0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </video>
Aug 16 10:32:27 user nova-compute[73067]:     <memballoon model='virtio'>
Aug 16 10:32:27 user nova-compute[73067]:       <stats period='10'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='balloon0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </memballoon>
Aug 16 10:32:27 user nova-compute[73067]:     <rng model='virtio'>
Aug 16 10:32:27 user nova-compute[73067]:       <backend model='random'>/dev/urandom</backend>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='rng0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </rng>
Aug 16 10:32:27 user nova-compute[73067]:   </devices>
Aug 16 10:32:27 user nova-compute[73067]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 10:32:27 user nova-compute[73067]:     <label>libvirt-65299891-9731-4b3b-b23e-85813d45eb58</label>
Aug 16 10:32:27 user nova-compute[73067]:     <imagelabel>libvirt-65299891-9731-4b3b-b23e-85813d45eb58</imagelabel>
Aug 16 10:32:27 user nova-compute[73067]:   </seclabel>
Aug 16 10:32:27 user nova-compute[73067]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 10:32:27 user nova-compute[73067]:     <label>+64055:+108</label>
Aug 16 10:32:27 user nova-compute[73067]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 10:32:27 user nova-compute[73067]:   </seclabel>
Aug 16 10:32:27 user nova-compute[73067]: </domain>
Aug 16 10:32:27 user nova-compute[73067]:  {{(pid=73067) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 10:32:27 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Successfully detached device tapdaebb0d5-13 from instance 65299891-9731-4b3b-b23e-85813d45eb58 from the persistent domain config.
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] (1/8): Attempting to detach device tapdaebb0d5-13 with device alias net1 from instance 65299891-9731-4b3b-b23e-85813d45eb58 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] detach device xml: <interface type="ethernet">
Aug 16 10:32:27 user nova-compute[73067]:   <mac address="fa:16:3e:aa:c8:94"/>
Aug 16 10:32:27 user nova-compute[73067]:   <model type="virtio"/>
Aug 16 10:32:27 user nova-compute[73067]:   <mtu size="1442"/>
Aug 16 10:32:27 user nova-compute[73067]:   <target dev="tapdaebb0d5-13"/>
Aug 16 10:32:27 user nova-compute[73067]: </interface>
Aug 16 10:32:27 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692181947.595257, 65299891-9731-4b3b-b23e-85813d45eb58 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Start waiting for the detach event from libvirt for device tapdaebb0d5-13 with device alias net1 for instance 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:aa:c8:94"/><model type="virtio"/><mtu size="1442"/><target dev="tapdaebb0d5-13"/></interface> {{(pid=73067) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:aa:c8:94"/><model type="virtio"/><mtu size="1442"/><target dev="tapdaebb0d5-13"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 16 10:32:27 user nova-compute[73067]:   <name>instance-00000008</name>
Aug 16 10:32:27 user nova-compute[73067]:   <uuid>65299891-9731-4b3b-b23e-85813d45eb58</uuid>
Aug 16 10:32:27 user nova-compute[73067]:   <metadata>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:32:27 user nova-compute[73067]:   <nova:package version="0.0.0"/>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:name>tempest-device-tagging-server-549440583</nova:name>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:creationTime>2023-08-16 10:32:05</nova:creationTime>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:flavor name="m1.tiny">
Aug 16 10:32:27 user nova-compute[73067]:     <nova:memory>512</nova:memory>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:disk>1</nova:disk>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:swap>0</nova:swap>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:vcpus>1</nova:vcpus>
Aug 16 10:32:27 user nova-compute[73067]:   </nova:flavor>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:owner>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:user uuid="77535d32f7044acb9972a0dea8b2d882">tempest-TaggedAttachmentsTest-632372241-project-member</nova:user>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:project uuid="78fc4d3a3d3249259022dc9de8015725">tempest-TaggedAttachmentsTest-632372241</nova:project>
Aug 16 10:32:27 user nova-compute[73067]:   </nova:owner>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:ports>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:port uuid="185f299d-2471-4692-9ead-a478e312f02e">
Aug 16 10:32:27 user nova-compute[73067]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 10:32:27 user nova-compute[73067]:     </nova:port>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:port uuid="daebb0d5-132f-4e96-86a8-1ab84c63f27d">
Aug 16 10:32:27 user nova-compute[73067]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Aug 16 10:32:27 user nova-compute[73067]:     </nova:port>
Aug 16 10:32:27 user nova-compute[73067]:   </nova:ports>
Aug 16 10:32:27 user nova-compute[73067]: </nova:instance>
Aug 16 10:32:27 user nova-compute[73067]:   </metadata>
Aug 16 10:32:27 user nova-compute[73067]:   <memory unit='KiB'>524288</memory>
Aug 16 10:32:27 user nova-compute[73067]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 10:32:27 user nova-compute[73067]:   <vcpu placement='static'>1</vcpu>
Aug 16 10:32:27 user nova-compute[73067]:   <resource>
Aug 16 10:32:27 user nova-compute[73067]:     <partition>/machine</partition>
Aug 16 10:32:27 user nova-compute[73067]:   </resource>
Aug 16 10:32:27 user nova-compute[73067]:   <sysinfo type='smbios'>
Aug 16 10:32:27 user nova-compute[73067]:     <system>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='version'>0.0.0</entry>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='serial'>65299891-9731-4b3b-b23e-85813d45eb58</entry>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='uuid'>65299891-9731-4b3b-b23e-85813d45eb58</entry>
Aug 16 10:32:27 user nova-compute[73067]:       <entry name='family'>Virtual Machine</entry>
Aug 16 10:32:27 user nova-compute[73067]:     </system>
Aug 16 10:32:27 user nova-compute[73067]:   </sysinfo>
Aug 16 10:32:27 user nova-compute[73067]:   <os>
Aug 16 10:32:27 user nova-compute[73067]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 10:32:27 user nova-compute[73067]:     <boot dev='hd'/>
Aug 16 10:32:27 user nova-compute[73067]:     <smbios mode='sysinfo'/>
Aug 16 10:32:27 user nova-compute[73067]:   </os>
Aug 16 10:32:27 user nova-compute[73067]:   <features>
Aug 16 10:32:27 user nova-compute[73067]:     <acpi/>
Aug 16 10:32:27 user nova-compute[73067]:     <apic/>
Aug 16 10:32:27 user nova-compute[73067]:     <vmcoreinfo state='on'/>
Aug 16 10:32:27 user nova-compute[73067]:   </features>
Aug 16 10:32:27 user nova-compute[73067]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 10:32:27 user nova-compute[73067]:     <model fallback='forbid'>Nehalem</model>
Aug 16 10:32:27 user nova-compute[73067]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 10:32:27 user nova-compute[73067]:     <feature policy='require' name='vme'/>
Aug 16 10:32:27 user nova-compute[73067]:     <feature policy='require' name='x2apic'/>
Aug 16 10:32:27 user nova-compute[73067]:     <feature policy='require' name='hypervisor'/>
Aug 16 10:32:27 user nova-compute[73067]:   </cpu>
Aug 16 10:32:27 user nova-compute[73067]:   <clock offset='utc'>
Aug 16 10:32:27 user nova-compute[73067]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 10:32:27 user nova-compute[73067]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 10:32:27 user nova-compute[73067]:     <timer name='hpet' present='no'/>
Aug 16 10:32:27 user nova-compute[73067]:   </clock>
Aug 16 10:32:27 user nova-compute[73067]:   <on_poweroff>destroy</on_poweroff>
Aug 16 10:32:27 user nova-compute[73067]:   <on_reboot>restart</on_reboot>
Aug 16 10:32:27 user nova-compute[73067]:   <on_crash>destroy</on_crash>
Aug 16 10:32:27 user nova-compute[73067]:   <devices>
Aug 16 10:32:27 user nova-compute[73067]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 10:32:27 user nova-compute[73067]:     <disk type='file' device='disk'>
Aug 16 10:32:27 user nova-compute[73067]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 10:32:27 user nova-compute[73067]:       <source file='/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk' index='2'/>
Aug 16 10:32:27 user nova-compute[73067]:       <backingStore type='file' index='3'>
Aug 16 10:32:27 user nova-compute[73067]:         <format type='raw'/>
Aug 16 10:32:27 user nova-compute[73067]:         <source file='/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832'/>
Aug 16 10:32:27 user nova-compute[73067]:         <backingStore/>
Aug 16 10:32:27 user nova-compute[73067]:       </backingStore>
Aug 16 10:32:27 user nova-compute[73067]:       <target dev='vda' bus='virtio'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='virtio-disk0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </disk>
Aug 16 10:32:27 user nova-compute[73067]:     <disk type='file' device='cdrom'>
Aug 16 10:32:27 user nova-compute[73067]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 10:32:27 user nova-compute[73067]:       <source file='/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk.config' index='1'/>
Aug 16 10:32:27 user nova-compute[73067]:       <backingStore/>
Aug 16 10:32:27 user nova-compute[73067]:       <target dev='hda' bus='ide'/>
Aug 16 10:32:27 user nova-compute[73067]:       <readonly/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='ide0-0-0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </disk>
Aug 16 10:32:27 user nova-compute[73067]:     <controller type='usb' index='0' model='none'>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='usb'/>
Aug 16 10:32:27 user nova-compute[73067]:     </controller>
Aug 16 10:32:27 user nova-compute[73067]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='pci.0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </controller>
Aug 16 10:32:27 user nova-compute[73067]:     <controller type='ide' index='0'>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='ide'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 10:32:27 user nova-compute[73067]:     </controller>
Aug 16 10:32:27 user nova-compute[73067]:     <interface type='ethernet'>
Aug 16 10:32:27 user nova-compute[73067]:       <mac address='fa:16:3e:62:c9:de'/>
Aug 16 10:32:27 user nova-compute[73067]:       <target dev='tap185f299d-24'/>
Aug 16 10:32:27 user nova-compute[73067]:       <model type='virtio'/>
Aug 16 10:32:27 user nova-compute[73067]:       <mtu size='1442'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='net0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </interface>
Aug 16 10:32:27 user nova-compute[73067]:     <serial type='pty'>
Aug 16 10:32:27 user nova-compute[73067]:       <source path='/dev/pts/7'/>
Aug 16 10:32:27 user nova-compute[73067]:       <log file='/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/console.log' append='off'/>
Aug 16 10:32:27 user nova-compute[73067]:       <target type='isa-serial' port='0'>
Aug 16 10:32:27 user nova-compute[73067]:         <model name='isa-serial'/>
Aug 16 10:32:27 user nova-compute[73067]:       </target>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='serial0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </serial>
Aug 16 10:32:27 user nova-compute[73067]:     <console type='pty' tty='/dev/pts/7'>
Aug 16 10:32:27 user nova-compute[73067]:       <source path='/dev/pts/7'/>
Aug 16 10:32:27 user nova-compute[73067]:       <log file='/opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/console.log' append='off'/>
Aug 16 10:32:27 user nova-compute[73067]:       <target type='serial' port='0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='serial0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </console>
Aug 16 10:32:27 user nova-compute[73067]:     <input type='mouse' bus='ps2'>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='input0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </input>
Aug 16 10:32:27 user nova-compute[73067]:     <input type='keyboard' bus='ps2'>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='input1'/>
Aug 16 10:32:27 user nova-compute[73067]:     </input>
Aug 16 10:32:27 user nova-compute[73067]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 16 10:32:27 user nova-compute[73067]:       <listen type='address' address='0.0.0.0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </graphics>
Aug 16 10:32:27 user nova-compute[73067]:     <audio id='1' type='none'/>
Aug 16 10:32:27 user nova-compute[73067]:     <video>
Aug 16 10:32:27 user nova-compute[73067]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='video0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </video>
Aug 16 10:32:27 user nova-compute[73067]:     <memballoon model='virtio'>
Aug 16 10:32:27 user nova-compute[73067]:       <stats period='10'/>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='balloon0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </memballoon>
Aug 16 10:32:27 user nova-compute[73067]:     <rng model='virtio'>
Aug 16 10:32:27 user nova-compute[73067]:       <backend model='random'>/dev/urandom</backend>
Aug 16 10:32:27 user nova-compute[73067]:       <alias name='rng0'/>
Aug 16 10:32:27 user nova-compute[73067]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 10:32:27 user nova-compute[73067]:     </rng>
Aug 16 10:32:27 user nova-compute[73067]:   </devices>
Aug 16 10:32:27 user nova-compute[73067]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 10:32:27 user nova-compute[73067]:     <label>libvirt-65299891-9731-4b3b-b23e-85813d45eb58</label>
Aug 16 10:32:27 user nova-compute[73067]:     <imagelabel>libvirt-65299891-9731-4b3b-b23e-85813d45eb58</imagelabel>
Aug 16 10:32:27 user nova-compute[73067]:   </seclabel>
Aug 16 10:32:27 user nova-compute[73067]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 10:32:27 user nova-compute[73067]:     <label>+64055:+108</label>
Aug 16 10:32:27 user nova-compute[73067]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 10:32:27 user nova-compute[73067]:   </seclabel>
Aug 16 10:32:27 user nova-compute[73067]: </domain>
Aug 16 10:32:27 user nova-compute[73067]:  {{(pid=73067) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 10:32:27 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Successfully detached device tapdaebb0d5-13 from instance 65299891-9731-4b3b-b23e-85813d45eb58 from the live domain config.
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-549440583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-549440583',id=8,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/ET4f+GadAJ2XEk1G0bW3MJhSK9fZRqno/3i6IGeLmLpNdtSstzLjv1zvrKcBm/cTzruDBnMijgSTFRsgfXO1gSW064pzF0QTVeNoDA8Zd2epUz5KDmPX2yAUQRp8fNw==',key_name='tempest-keypair-1652680034',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78fc4d3a3d3249259022dc9de8015725',ramdisk_id='',reservation_id='r-sc8f08j5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-632372241',owner_user_name='tempest-TaggedAttachmentsTest-632372241-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77535d32f7044acb9972a0dea8b2d882',uuid=65299891-9731-4b3b-b23e-85813d45eb58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "address": "fa:16:3e:aa:c8:94", "network": {"id": "740038fc-059f-44eb-80eb-3b9c6e80ca8f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1545027352", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebb0d5-13", "ovs_interfaceid": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converting VIF {"id": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "address": "fa:16:3e:aa:c8:94", "network": {"id": "740038fc-059f-44eb-80eb-3b9c6e80ca8f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1545027352", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebb0d5-13", "ovs_interfaceid": "daebb0d5-132f-4e96-86a8-1ab84c63f27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c8:94,bridge_name='br-int',has_traffic_filtering=True,id=daebb0d5-132f-4e96-86a8-1ab84c63f27d,network=Network(740038fc-059f-44eb-80eb-3b9c6e80ca8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebb0d5-13') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG os_vif [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c8:94,bridge_name='br-int',has_traffic_filtering=True,id=daebb0d5-132f-4e96-86a8-1ab84c63f27d,network=Network(740038fc-059f-44eb-80eb-3b9c6e80ca8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebb0d5-13') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaebb0d5-13, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:27 user nova-compute[73067]: INFO os_vif [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c8:94,bridge_name='br-int',has_traffic_filtering=True,id=daebb0d5-132f-4e96-86a8-1ab84c63f27d,network=Network(740038fc-059f-44eb-80eb-3b9c6e80ca8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebb0d5-13')
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:32:27 user nova-compute[73067]:   <nova:package version="0.0.0"/>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:name>tempest-device-tagging-server-549440583</nova:name>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:creationTime>2023-08-16 10:32:27</nova:creationTime>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:flavor name="m1.tiny">
Aug 16 10:32:27 user nova-compute[73067]:     <nova:memory>512</nova:memory>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:disk>1</nova:disk>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:swap>0</nova:swap>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:vcpus>1</nova:vcpus>
Aug 16 10:32:27 user nova-compute[73067]:   </nova:flavor>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:owner>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:user uuid="77535d32f7044acb9972a0dea8b2d882">tempest-TaggedAttachmentsTest-632372241-project-member</nova:user>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:project uuid="78fc4d3a3d3249259022dc9de8015725">tempest-TaggedAttachmentsTest-632372241</nova:project>
Aug 16 10:32:27 user nova-compute[73067]:   </nova:owner>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:32:27 user nova-compute[73067]:   <nova:ports>
Aug 16 10:32:27 user nova-compute[73067]:     <nova:port uuid="185f299d-2471-4692-9ead-a478e312f02e">
Aug 16 10:32:27 user nova-compute[73067]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 10:32:27 user nova-compute[73067]:     </nova:port>
Aug 16 10:32:27 user nova-compute[73067]:   </nova:ports>
Aug 16 10:32:27 user nova-compute[73067]: </nova:instance>
Aug 16 10:32:27 user nova-compute[73067]:  {{(pid=73067) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-d35dc7b0-74c7-4989-9361-a5da3e78940d req-59f34ce0-d3e1-47f0-8a8c-3ecfc0abea67 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-unplugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d35dc7b0-74c7-4989-9361-a5da3e78940d req-59f34ce0-d3e1-47f0-8a8c-3ecfc0abea67 service nova] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d35dc7b0-74c7-4989-9361-a5da3e78940d req-59f34ce0-d3e1-47f0-8a8c-3ecfc0abea67 service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d35dc7b0-74c7-4989-9361-a5da3e78940d req-59f34ce0-d3e1-47f0-8a8c-3ecfc0abea67 service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-d35dc7b0-74c7-4989-9361-a5da3e78940d req-59f34ce0-d3e1-47f0-8a8c-3ecfc0abea67 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] No waiting events found dispatching network-vif-unplugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:27 user nova-compute[73067]: WARNING nova.compute.manager [req-d35dc7b0-74c7-4989-9361-a5da3e78940d req-59f34ce0-d3e1-47f0-8a8c-3ecfc0abea67 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received unexpected event network-vif-unplugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d for instance with vm_state active and task_state None.
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquired lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG nova.network.neutron [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:28 user nova-compute[73067]: INFO nova.network.neutron [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Port daebb0d5-132f-4e96-86a8-1ab84c63f27d from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 16 10:32:28 user nova-compute[73067]: DEBUG nova.network.neutron [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updating instance_info_cache with network_info: [{"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:32:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Releasing lock "refresh_cache-65299891-9731-4b3b-b23e-85813d45eb58" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44d56f8c-d989-4c8a-aa84-2f0bc7726a8a tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "interface-65299891-9731-4b3b-b23e-85813d45eb58-daebb0d5-132f-4e96-86a8-1ab84c63f27d" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.843s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-eccbdd9a-8f93-4fda-b9a3-49221f9a9d38 req-0392f851-89cb-4e1d-9d65-9374a31bf8d5 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-plugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-eccbdd9a-8f93-4fda-b9a3-49221f9a9d38 req-0392f851-89cb-4e1d-9d65-9374a31bf8d5 service nova] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-eccbdd9a-8f93-4fda-b9a3-49221f9a9d38 req-0392f851-89cb-4e1d-9d65-9374a31bf8d5 service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-eccbdd9a-8f93-4fda-b9a3-49221f9a9d38 req-0392f851-89cb-4e1d-9d65-9374a31bf8d5 service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-eccbdd9a-8f93-4fda-b9a3-49221f9a9d38 req-0392f851-89cb-4e1d-9d65-9374a31bf8d5 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] No waiting events found dispatching network-vif-plugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:29 user nova-compute[73067]: WARNING nova.compute.manager [req-eccbdd9a-8f93-4fda-b9a3-49221f9a9d38 req-0392f851-89cb-4e1d-9d65-9374a31bf8d5 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received unexpected event network-vif-plugged-daebb0d5-132f-4e96-86a8-1ab84c63f27d for instance with vm_state active and task_state None.
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-eccbdd9a-8f93-4fda-b9a3-49221f9a9d38 req-0392f851-89cb-4e1d-9d65-9374a31bf8d5 service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-deleted-daebb0d5-132f-4e96-86a8-1ab84c63f27d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:29 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:32:29 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=6985MB free_disk=25.559326171875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b51879a0-d5a1-4f96-b0c1-0672d31e80db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 65299891-9731-4b3b-b23e-85813d45eb58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a050d0a6-0349-478a-8efc-fc4907ed20da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b8758033-0b89-4953-b96b-0dc227bb3a3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:32:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:32:30 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:32:30 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:32:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:32:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updating instance_info_cache with network_info: [{"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:32:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:32:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:33 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692181938.2093325, bc2b0cc0-5227-4e0d-8823-3bc82bd30e22 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:32:33 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] VM Stopped (Lifecycle Event)
Aug 16 10:32:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-006a89f0-ead9-473a-bd56-c1c2781fdf61 None None] [instance: bc2b0cc0-5227-4e0d-8823-3bc82bd30e22] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:32:35 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692181940.4784195, f765ae8f-01ae-4eaf-a1ec-daaba1c72be1 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:32:35 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] VM Stopped (Lifecycle Event)
Aug 16 10:32:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d17e05f1-ef33-4c96-988a-67d7398ba1c3 None None] [instance: f765ae8f-01ae-4eaf-a1ec-daaba1c72be1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:32:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:53 user nova-compute[73067]: DEBUG nova.compute.manager [req-4129cb25-4a7d-4541-94a7-522c0b2f171a req-2857102e-e9c7-4220-8503-a19a68a5ed13 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-changed-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:53 user nova-compute[73067]: DEBUG nova.compute.manager [req-4129cb25-4a7d-4541-94a7-522c0b2f171a req-2857102e-e9c7-4220-8503-a19a68a5ed13 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing instance network info cache due to event network-changed-7af2b562-e0cb-4411-ab63-236edb74c04c. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:32:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4129cb25-4a7d-4541-94a7-522c0b2f171a req-2857102e-e9c7-4220-8503-a19a68a5ed13 service nova] Acquiring lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:32:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4129cb25-4a7d-4541-94a7-522c0b2f171a req-2857102e-e9c7-4220-8503-a19a68a5ed13 service nova] Acquired lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:32:53 user nova-compute[73067]: DEBUG nova.network.neutron [req-4129cb25-4a7d-4541-94a7-522c0b2f171a req-2857102e-e9c7-4220-8503-a19a68a5ed13 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Refreshing network info cache for port 7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:32:54 user nova-compute[73067]: DEBUG nova.network.neutron [req-4129cb25-4a7d-4541-94a7-522c0b2f171a req-2857102e-e9c7-4220-8503-a19a68a5ed13 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updated VIF entry in instance network info cache for port 7af2b562-e0cb-4411-ab63-236edb74c04c. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:32:54 user nova-compute[73067]: DEBUG nova.network.neutron [req-4129cb25-4a7d-4541-94a7-522c0b2f171a req-2857102e-e9c7-4220-8503-a19a68a5ed13 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [{"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:32:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4129cb25-4a7d-4541-94a7-522c0b2f171a req-2857102e-e9c7-4220-8503-a19a68a5ed13 service nova] Releasing lock "refresh_cache-a050d0a6-0349-478a-8efc-fc4907ed20da" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:32:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:56 user nova-compute[73067]: INFO nova.compute.manager [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Terminating instance
Aug 16 10:32:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-0c2019d2-76ed-41d2-8c65-4b778b087641 req-827732ef-83a8-4080-b416-4c576b1008e7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0c2019d2-76ed-41d2-8c65-4b778b087641 req-827732ef-83a8-4080-b416-4c576b1008e7 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0c2019d2-76ed-41d2-8c65-4b778b087641 req-827732ef-83a8-4080-b416-4c576b1008e7 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0c2019d2-76ed-41d2-8c65-4b778b087641 req-827732ef-83a8-4080-b416-4c576b1008e7 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-0c2019d2-76ed-41d2-8c65-4b778b087641 req-827732ef-83a8-4080-b416-4c576b1008e7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-unplugged-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-0c2019d2-76ed-41d2-8c65-4b778b087641 req-827732ef-83a8-4080-b416-4c576b1008e7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-7af2b562-e0cb-4411-ab63-236edb74c04c for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-eb577fb2-2dea-4fce-a74e-82a304acda1a req-ddd62742-15aa-4cf7-a12a-8fa8bfaf84b7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-eb577fb2-2dea-4fce-a74e-82a304acda1a req-ddd62742-15aa-4cf7-a12a-8fa8bfaf84b7 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-eb577fb2-2dea-4fce-a74e-82a304acda1a req-ddd62742-15aa-4cf7-a12a-8fa8bfaf84b7 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-eb577fb2-2dea-4fce-a74e-82a304acda1a req-ddd62742-15aa-4cf7-a12a-8fa8bfaf84b7 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-eb577fb2-2dea-4fce-a74e-82a304acda1a req-ddd62742-15aa-4cf7-a12a-8fa8bfaf84b7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-unplugged-3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-eb577fb2-2dea-4fce-a74e-82a304acda1a req-ddd62742-15aa-4cf7-a12a-8fa8bfaf84b7 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-3fb8bad8-53b7-452c-8887-670c2db92f1f for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-30492ed3-d8f3-4aaf-bea7-81a1e033d09f req-5593f652-7182-4aec-b4fe-23ce486a0771 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-30492ed3-d8f3-4aaf-bea7-81a1e033d09f req-5593f652-7182-4aec-b4fe-23ce486a0771 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-30492ed3-d8f3-4aaf-bea7-81a1e033d09f req-5593f652-7182-4aec-b4fe-23ce486a0771 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-30492ed3-d8f3-4aaf-bea7-81a1e033d09f req-5593f652-7182-4aec-b4fe-23ce486a0771 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-30492ed3-d8f3-4aaf-bea7-81a1e033d09f req-5593f652-7182-4aec-b4fe-23ce486a0771 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-unplugged-8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-30492ed3-d8f3-4aaf-bea7-81a1e033d09f req-5593f652-7182-4aec-b4fe-23ce486a0771 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-8dce82be-b2e8-47c2-830c-1040265820b7 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Instance destroyed successfully.
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.objects.instance [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lazy-loading 'resources' on Instance uuid a050d0a6-0349-478a-8efc-fc4907ed20da {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=7af2b562-e0cb-4411-ab63-236edb74c04c,network=Network(e4168c39-12cd-485f-9348-f43705293af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af2b562-e0') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=7af2b562-e0cb-4411-ab63-236edb74c04c,network=Network(e4168c39-12cd-485f-9348-f43705293af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af2b562-e0') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7af2b562-e0, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: INFO os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=7af2b562-e0cb-4411-ab63-236edb74c04c,network=Network(e4168c39-12cd-485f-9348-f43705293af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af2b562-e0')
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=3fb8bad8-53b7-452c-8887-670c2db92f1f,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fb8bad8-53') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=3fb8bad8-53b7-452c-8887-670c2db92f1f,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fb8bad8-53') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fb8bad8-53, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: INFO os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=3fb8bad8-53b7-452c-8887-670c2db92f1f,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fb8bad8-53')
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9b:fe,bridge_name='br-int',has_traffic_filtering=True,id=7cdb6fd9-c2d7-47d8-88d3-5e064597b51d,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cdb6fd9-c2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9b:fe,bridge_name='br-int',has_traffic_filtering=True,id=7cdb6fd9-c2d7-47d8-88d3-5e064597b51d,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cdb6fd9-c2') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cdb6fd9-c2, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: INFO os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9b:fe,bridge_name='br-int',has_traffic_filtering=True,id=7cdb6fd9-c2d7-47d8-88d3-5e064597b51d,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cdb6fd9-c2')
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "address": "fa:16:3e:02:c8:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1cbdeb-34", "ovs_interfaceid": "fb1cbdeb-3468-4c81-a757-3b54f92aa510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:c8:15,bridge_name='br-int',has_traffic_filtering=True,id=fb1cbdeb-3468-4c81-a757-3b54f92aa510,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1cbdeb-34') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:c8:15,bridge_name='br-int',has_traffic_filtering=True,id=fb1cbdeb-3468-4c81-a757-3b54f92aa510,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1cbdeb-34') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb1cbdeb-34, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: INFO os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:c8:15,bridge_name='br-int',has_traffic_filtering=True,id=fb1cbdeb-3468-4c81-a757-3b54f92aa510,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1cbdeb-34')
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fe03e438-e13b-4b98-bd68-ff3638588926,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe03e438-e1') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fe03e438-e13b-4b98-bd68-ff3638588926,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe03e438-e1') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe03e438-e1, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: INFO os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fe03e438-e13b-4b98-bd68-ff3638588926,network=Network(2bb71b21-56b0-449d-a475-b0d40d58b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe03e438-e1')
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=367839d4-788f-4f24-9c3e-9df8ff551c87,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367839d4-78') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=367839d4-788f-4f24-9c3e-9df8ff551c87,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367839d4-78') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap367839d4-78, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: INFO os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=367839d4-788f-4f24-9c3e-9df8ff551c87,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367839d4-78')
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1277027415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1277027415',id=11,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHkNNryTy+R+lvQmSQBv8uhQVVz09QAT3W5/bfm78/KR8YXVh3kCekGJzv40jvze5NYCm4NiPuqJiWk0w+YWbSkUdx162jQbvwEdPkTk9BsHTkTt4XaWd1w6+00yu4TzQ==',key_name='tempest-keypair-355945539',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912f3a50bdde41b8ad33424f28d22145',ramdisk_id='',reservation_id='r-wtuwvld5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-13980695',owner_user_name='tempest-TaggedBootDevicesTest-13980695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999535c10b504af48797e8511fdf99c5',uuid=a050d0a6-0349-478a-8efc-fc4907ed20da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converting VIF {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:71:10,bridge_name='br-int',has_traffic_filtering=True,id=8dce82be-b2e8-47c2-830c-1040265820b7,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dce82be-b2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:71:10,bridge_name='br-int',has_traffic_filtering=True,id=8dce82be-b2e8-47c2-830c-1040265820b7,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dce82be-b2') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8dce82be-b2, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:32:58 user nova-compute[73067]: INFO os_vif [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:71:10,bridge_name='br-int',has_traffic_filtering=True,id=8dce82be-b2e8-47c2-830c-1040265820b7,network=Network(51d853c7-be96-4319-abb9-0007a7dafa98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dce82be-b2')
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saLDdwYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:58 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b49571a-be9f-48d5-9679-28ebe7815341]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da531d5-72e0-47fd-a4d1-5bc1cfe84361]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:58 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 (non-flash)
Aug 16 10:32:58 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35841cc790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390'): ({'sdg'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Removing single pathed devices sdg {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab550bd8-ddff-4349-b05e-0aa9444c0e8b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[17309bcd-d0c8-4b70-b468-00a214ce613e]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Flushing IO for device /dev/sdg {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7df835-04cd-4be6-9e55-6ef4c38d8749]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9c0ba6-c57b-4d3f-b89a-74b2e50f99dc]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] SCSI volumes sdg have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[02894f23-41ca-4322-b53e-2cb7a9cd64c1]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b607180-18fa-4aa5-9cd3-539a7657806f]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390, portal: 172.16.0.220,3260]
Aug 16 10:32:58 user nova-compute[73067]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:58 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:58 user nova-compute[73067]: WARNING nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-7af2b562-e0cb-4411-ab63-236edb74c04c for instance with vm_state active and task_state deleting.
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-unplugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:58 user nova-compute[73067]: WARNING nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-7cdb6fd9-c2d7-47d8-88d3-5e064597b51d for instance with vm_state active and task_state deleting.
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-unplugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:58 user nova-compute[73067]: WARNING nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-fb1cbdeb-3468-4c81-a757-3b54f92aa510 for instance with vm_state active and task_state deleting.
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-unplugged-fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-fe03e438-e13b-4b98-bd68-ff3638588926 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:58 user nova-compute[73067]: WARNING nova.compute.manager [req-a9d68ff7-2287-41d7-b50b-02d000d1e71c req-bf16ec4d-dd13-482f-bc1d-de23feabd36e service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-fe03e438-e13b-4b98-bd68-ff3638588926 for instance with vm_state active and task_state deleting.
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37891010-9dac-4458-9675-352492b59390 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[797bb3d6-3aa4-4a47-8d31-4496ef1702ed]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] <== disconnect_volume: return (363ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cinhKJrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:58 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[145ad6a0-4beb-453d-a6bb-ad34f3f85677]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-3fb8bad8-53b7-452c-8887-670c2db92f1f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:58 user nova-compute[73067]: WARNING nova.compute.manager [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-3fb8bad8-53b7-452c-8887-670c2db92f1f for instance with vm_state active and task_state deleting.
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-unplugged-367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-unplugged-367839d4-788f-4f24-9c3e-9df8ff551c87 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:58 user nova-compute[73067]: WARNING nova.compute.manager [req-327433d5-0b66-4d8a-83ee-64a7ca3b19fc req-9e23cd14-ca1f-4609-98f1-42b65d408cbb service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-367839d4-788f-4f24-9c3e-9df8ff551c87 for instance with vm_state active and task_state deleting.
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c55298-935b-4f61-a048-179c884457f8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:58 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe (non-flash)
Aug 16 10:32:58 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:58 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642b5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe'): ({'sdd'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Removing single pathed devices sdd {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[80134848-53e1-45a6-9bf7-967784d73848]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e2f2f0-2ff4-4930-92a7-8f4875a77406]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Flushing IO for device /dev/sdd {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf6e62-2cd1-4c5a-b09a-c440676f5c73]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0816677e-69e4-45f5-92f2-a9be3d03d110]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9531466-d1e6-4445-a230-52f1669cd167]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[509402e1-deda-41ce-b931-082626e85290]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe, portal: 172.16.0.220,3260]
Aug 16 10:32:59 user nova-compute[73067]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:59 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1dc418-28fc-4ebb-a684-1c16442608fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4532342a-3b24-4ed4-8127-20e414b00d9d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] <== disconnect_volume: return (298ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGEINuXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:32:59 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[df23253e-a8d5-4e34-9c74-721391c563ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b41723-3a6d-49d0-b36b-ae3b278e1596]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:59 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:59 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:59 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:59 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:32:59 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:32:59 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:32:59 user nova-compute[73067]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c (non-flash)
Aug 16 10:32:59 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f356462dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c'): ({'sdf'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Removing single pathed devices sdf {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2909f6-28e7-4c61-8d42-1a6022815ab8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00ef25b-6a5a-45c2-8044-1a443141691f]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Flushing IO for device /dev/sdf {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53be684-f4ef-43f3-9ea7-5540ee42d0e2]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5497ac1f-6730-4552-bc7b-42f1a5a03f81]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] SCSI volumes sdf have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[575b6069-575f-4854-aa50-f08bfbe20f8d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b351eb9-7015-4684-98b0-9bc303178677]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c, portal: 172.16.0.220,3260]
Aug 16 10:32:59 user nova-compute[73067]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c, portal: 172.16.0.220,3260] successful.
Aug 16 10:32:59 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG nova.compute.manager [req-a3590d43-d577-46ee-b84c-2aa25da0df41 req-7afa2b47-a76d-41e8-8b39-b0d3426700e4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-plugged-8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a3590d43-d577-46ee-b84c-2aa25da0df41 req-7afa2b47-a76d-41e8-8b39-b0d3426700e4 service nova] Acquiring lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a3590d43-d577-46ee-b84c-2aa25da0df41 req-7afa2b47-a76d-41e8-8b39-b0d3426700e4 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a3590d43-d577-46ee-b84c-2aa25da0df41 req-7afa2b47-a76d-41e8-8b39-b0d3426700e4 service nova] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG nova.compute.manager [req-a3590d43-d577-46ee-b84c-2aa25da0df41 req-7afa2b47-a76d-41e8-8b39-b0d3426700e4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] No waiting events found dispatching network-vif-plugged-8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:32:59 user nova-compute[73067]: WARNING nova.compute.manager [req-a3590d43-d577-46ee-b84c-2aa25da0df41 req-7afa2b47-a76d-41e8-8b39-b0d3426700e4 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received unexpected event network-vif-plugged-8dce82be-b2e8-47c2-830c-1040265820b7 for instance with vm_state active and task_state deleting.
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54dbc73-fb26-416a-9a71-95d17774f30c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdc5492-b40d-45a3-8702-8e478587b0f7]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] <== disconnect_volume: return (292ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:32:59 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Deleting instance files /opt/stack/data/nova/instances/a050d0a6-0349-478a-8efc-fc4907ed20da_del
Aug 16 10:32:59 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Deletion of /opt/stack/data/nova/instances/a050d0a6-0349-478a-8efc-fc4907ed20da_del complete
Aug 16 10:32:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Took 3.19 seconds to destroy the instance on the hypervisor.
Aug 16 10:32:59 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:32:59 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:33:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-a05aa81b-9f70-4b3e-95c7-3a65fe748860 req-cd954741-7e24-4359-b47f-90133f21c70e service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received event network-changed-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-a05aa81b-9f70-4b3e-95c7-3a65fe748860 req-cd954741-7e24-4359-b47f-90133f21c70e service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Refreshing instance network info cache due to event network-changed-911406a5-d202-4d4a-88e0-237a6168701b. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:33:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a05aa81b-9f70-4b3e-95c7-3a65fe748860 req-cd954741-7e24-4359-b47f-90133f21c70e service nova] Acquiring lock "refresh_cache-b8758033-0b89-4953-b96b-0dc227bb3a3d" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a05aa81b-9f70-4b3e-95c7-3a65fe748860 req-cd954741-7e24-4359-b47f-90133f21c70e service nova] Acquired lock "refresh_cache-b8758033-0b89-4953-b96b-0dc227bb3a3d" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:01 user nova-compute[73067]: DEBUG nova.network.neutron [req-a05aa81b-9f70-4b3e-95c7-3a65fe748860 req-cd954741-7e24-4359-b47f-90133f21c70e service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Refreshing network info cache for port 911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-7e72ea10-11e8-4408-ab93-cd13f370720a req-2d78f7a5-844e-4e07-9f10-9f95b5932dce service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-deleted-fb1cbdeb-3468-4c81-a757-3b54f92aa510 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:02 user nova-compute[73067]: INFO nova.compute.manager [req-7e72ea10-11e8-4408-ab93-cd13f370720a req-2d78f7a5-844e-4e07-9f10-9f95b5932dce service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Neutron deleted interface fb1cbdeb-3468-4c81-a757-3b54f92aa510; detaching it from the instance and deleting it from the info cache
Aug 16 10:33:02 user nova-compute[73067]: DEBUG nova.network.neutron [req-7e72ea10-11e8-4408-ab93-cd13f370720a req-2d78f7a5-844e-4e07-9f10-9f95b5932dce service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [{"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe03e438-e13b-4b98-bd68-ff3638588926", "address": "fa:16:3e:7a:c4:07", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe03e438-e1", "ovs_interfaceid": "fe03e438-e13b-4b98-bd68-ff3638588926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG nova.objects.instance [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'flavor' on Instance uuid b8758033-0b89-4953-b96b-0dc227bb3a3d {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-7e72ea10-11e8-4408-ab93-cd13f370720a req-2d78f7a5-844e-4e07-9f10-9f95b5932dce service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Detach interface failed, port_id=fb1cbdeb-3468-4c81-a757-3b54f92aa510, reason: Instance a050d0a6-0349-478a-8efc-fc4907ed20da could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:33:02 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Ignoring supplied device name: /dev/vdb
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:02 user nova-compute[73067]: INFO nova.compute.manager [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Attaching volume 91da7944-7fb3-409f-be3d-615f989058d3 to /dev/vdb
Aug 16 10:33:02 user nova-compute[73067]: DEBUG os_brick.utils [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5902893-f54b-4950-9573-3ca9a7c2b591]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[97810bea-a0d7-442c-ae9c-f08a2c0d7725]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79edefd-744f-4425-b97d-86db488cb609]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[986cd7e2-88a2-4ce2-b4b7-5800d964b91a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:33:02 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:33:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5c46e2-1b38-4ad9-a35d-58139213fce6]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG os_brick.utils [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Updating existing volume attachment record: f6316eb3-5629-4e64-b532-571f32d08634 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG nova.network.neutron [req-a05aa81b-9f70-4b3e-95c7-3a65fe748860 req-cd954741-7e24-4359-b47f-90133f21c70e service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Updated VIF entry in instance network info cache for port 911406a5-d202-4d4a-88e0-237a6168701b. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:33:02 user nova-compute[73067]: DEBUG nova.network.neutron [req-a05aa81b-9f70-4b3e-95c7-3a65fe748860 req-cd954741-7e24-4359-b47f-90133f21c70e service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Updating instance_info_cache with network_info: [{"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a05aa81b-9f70-4b3e-95c7-3a65fe748860 req-cd954741-7e24-4359-b47f-90133f21c70e service nova] Releasing lock "refresh_cache-b8758033-0b89-4953-b96b-0dc227bb3a3d" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-d07477af-a41f-422e-8e6e-952ee590700d req-4dfc8b05-9fe5-49c2-aeb3-16b1cbfe565b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-deleted-fe03e438-e13b-4b98-bd68-ff3638588926 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:04 user nova-compute[73067]: INFO nova.compute.manager [req-d07477af-a41f-422e-8e6e-952ee590700d req-4dfc8b05-9fe5-49c2-aeb3-16b1cbfe565b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Neutron deleted interface fe03e438-e13b-4b98-bd68-ff3638588926; detaching it from the instance and deleting it from the info cache
Aug 16 10:33:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-d07477af-a41f-422e-8e6e-952ee590700d req-4dfc8b05-9fe5-49c2-aeb3-16b1cbfe565b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [{"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dce82be-b2e8-47c2-830c-1040265820b7", "address": "fa:16:3e:de:71:10", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dce82be-b2", "ovs_interfaceid": "8dce82be-b2e8-47c2-830c-1040265820b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-d07477af-a41f-422e-8e6e-952ee590700d req-4dfc8b05-9fe5-49c2-aeb3-16b1cbfe565b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Detach interface failed, port_id=fe03e438-e13b-4b98-bd68-ff3638588926, reason: Instance a050d0a6-0349-478a-8efc-fc4907ed20da could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:33:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-d07477af-a41f-422e-8e6e-952ee590700d req-4dfc8b05-9fe5-49c2-aeb3-16b1cbfe565b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-deleted-8dce82be-b2e8-47c2-830c-1040265820b7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:04 user nova-compute[73067]: INFO nova.compute.manager [req-d07477af-a41f-422e-8e6e-952ee590700d req-4dfc8b05-9fe5-49c2-aeb3-16b1cbfe565b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Neutron deleted interface 8dce82be-b2e8-47c2-830c-1040265820b7; detaching it from the instance and deleting it from the info cache
Aug 16 10:33:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-d07477af-a41f-422e-8e6e-952ee590700d req-4dfc8b05-9fe5-49c2-aeb3-16b1cbfe565b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [{"id": "7af2b562-e0cb-4411-ab63-236edb74c04c", "address": "fa:16:3e:a8:ea:da", "network": {"id": "e4168c39-12cd-485f-9348-f43705293af2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1549760548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af2b562-e0", "ovs_interfaceid": "7af2b562-e0cb-4411-ab63-236edb74c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "address": "fa:16:3e:7d:bd:15", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb8bad8-53", "ovs_interfaceid": "3fb8bad8-53b7-452c-8887-670c2db92f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "address": "fa:16:3e:7b:9b:fe", "network": {"id": "2bb71b21-56b0-449d-a475-b0d40d58b8c8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2130621401", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdb6fd9-c2", "ovs_interfaceid": "7cdb6fd9-c2d7-47d8-88d3-5e064597b51d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "367839d4-788f-4f24-9c3e-9df8ff551c87", "address": "fa:16:3e:51:d7:c9", "network": {"id": "51d853c7-be96-4319-abb9-0007a7dafa98", "bridge": "br-int", "label": "tempest-device-tagging-net2-651876697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "912f3a50bdde41b8ad33424f28d22145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367839d4-78", "ovs_interfaceid": "367839d4-788f-4f24-9c3e-9df8ff551c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-d07477af-a41f-422e-8e6e-952ee590700d req-4dfc8b05-9fe5-49c2-aeb3-16b1cbfe565b service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Detach interface failed, port_id=8dce82be-b2e8-47c2-830c-1040265820b7, reason: Instance a050d0a6-0349-478a-8efc-fc4907ed20da could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:33:04 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:04 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Took 5.37 seconds to deallocate network for instance.
Aug 16 10:33:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "f7014e03-d278-40cf-8a7b-c798d76c87b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:33:06 user nova-compute[73067]: INFO nova.compute.claims [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Claim successful on node user
Aug 16 10:33:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-0fd8619f-344b-46b9-b735-770609a8a680 req-68e5f47a-326c-40ad-96d0-25fed0d8c623 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-deleted-7af2b562-e0cb-4411-ab63-236edb74c04c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-0fd8619f-344b-46b9-b735-770609a8a680 req-68e5f47a-326c-40ad-96d0-25fed0d8c623 service nova] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Received event network-vif-deleted-367839d4-788f-4f24-9c3e-9df8ff551c87 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:33:06 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:33:06 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:33:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.policy [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b63f9ed0b5294eaf8919cf4c9bcea4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e7f124a2a74ac482ff13de710ba04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:33:07 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Creating image(s)
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "/opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "/opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:07 user nova-compute[73067]: INFO nova.compute.manager [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Took 2.52 seconds to detach 3 volumes for instance.
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk 1073741824" returned: 0 in 0.063s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Successfully created port: c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.204s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Cannot resize image /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lazy-loading 'migration_context' on Instance uuid f7014e03-d278-40cf-8a7b-c798d76c87b0 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Ensure instance console log exists: /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:07 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Deleted allocations for instance a050d0a6-0349-478a-8efc-fc4907ed20da
Aug 16 10:33:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c572d00-e4f8-43af-9f72-b8b38bc573bf tempest-TaggedBootDevicesTest-13980695 tempest-TaggedBootDevicesTest-13980695-project-member] Lock "a050d0a6-0349-478a-8efc-fc4907ed20da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.807s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:08 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Successfully updated port: c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:33:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "refresh_cache-f7014e03-d278-40cf-8a7b-c798d76c87b0" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquired lock "refresh_cache-f7014e03-d278-40cf-8a7b-c798d76c87b0" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:08 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:33:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-09b2f9bb-5608-41f0-9ce0-4a69419c53b8 req-4ca3b374-3b6c-49c4-ba11-dd6c600cb15f service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Received event network-changed-c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-09b2f9bb-5608-41f0-9ce0-4a69419c53b8 req-4ca3b374-3b6c-49c4-ba11-dd6c600cb15f service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Refreshing instance network info cache due to event network-changed-c96e297b-67f9-41f9-b396-87710eb267bc. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:33:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-09b2f9bb-5608-41f0-9ce0-4a69419c53b8 req-4ca3b374-3b6c-49c4-ba11-dd6c600cb15f service nova] Acquiring lock "refresh_cache-f7014e03-d278-40cf-8a7b-c798d76c87b0" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:08 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Updating instance_info_cache with network_info: [{"id": "c96e297b-67f9-41f9-b396-87710eb267bc", "address": "fa:16:3e:97:29:19", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96e297b-67", "ovs_interfaceid": "c96e297b-67f9-41f9-b396-87710eb267bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Releasing lock "refresh_cache-f7014e03-d278-40cf-8a7b-c798d76c87b0" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Instance network_info: |[{"id": "c96e297b-67f9-41f9-b396-87710eb267bc", "address": "fa:16:3e:97:29:19", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96e297b-67", "ovs_interfaceid": "c96e297b-67f9-41f9-b396-87710eb267bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-09b2f9bb-5608-41f0-9ce0-4a69419c53b8 req-4ca3b374-3b6c-49c4-ba11-dd6c600cb15f service nova] Acquired lock "refresh_cache-f7014e03-d278-40cf-8a7b-c798d76c87b0" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.network.neutron [req-09b2f9bb-5608-41f0-9ce0-4a69419c53b8 req-4ca3b374-3b6c-49c4-ba11-dd6c600cb15f service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Refreshing network info cache for port c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Start _get_guest_xml network_info=[{"id": "c96e297b-67f9-41f9-b396-87710eb267bc", "address": "fa:16:3e:97:29:19", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96e297b-67", "ovs_interfaceid": "c96e297b-67f9-41f9-b396-87710eb267bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:33:09 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:33:09 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-766796936',display_name='tempest-VolumesAdminNegativeTest-server-766796936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-766796936',id=14,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e7f124a2a74ac482ff13de710ba04a',ramdisk_id='',reservation_id='r-b2sbd78o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1324591370',owner_user_name='tempest-VolumesAdminNegativeTest-1324591370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:33:07Z,user_data=None,user_id='b63f9ed0b5294eaf8919cf4c9bcea4ea',uuid=f7014e03-d278-40cf-8a7b-c798d76c87b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c96e297b-67f9-41f9-b396-87710eb267bc", "address": "fa:16:3e:97:29:19", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96e297b-67", "ovs_interfaceid": "c96e297b-67f9-41f9-b396-87710eb267bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converting VIF {"id": "c96e297b-67f9-41f9-b396-87710eb267bc", "address": "fa:16:3e:97:29:19", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96e297b-67", "ovs_interfaceid": "c96e297b-67f9-41f9-b396-87710eb267bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:29:19,bridge_name='br-int',has_traffic_filtering=True,id=c96e297b-67f9-41f9-b396-87710eb267bc,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96e297b-67') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lazy-loading 'pci_devices' on Instance uuid f7014e03-d278-40cf-8a7b-c798d76c87b0 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:33:09 user nova-compute[73067]:   <uuid>f7014e03-d278-40cf-8a7b-c798d76c87b0</uuid>
Aug 16 10:33:09 user nova-compute[73067]:   <name>instance-0000000e</name>
Aug 16 10:33:09 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:33:09 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:33:09 user nova-compute[73067]:   <metadata>
Aug 16 10:33:09 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:33:09 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:33:09 user nova-compute[73067]:       <nova:name>tempest-VolumesAdminNegativeTest-server-766796936</nova:name>
Aug 16 10:33:09 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:33:09</nova:creationTime>
Aug 16 10:33:09 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:33:09 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:33:09 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:33:09 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:33:09 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:33:09 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:33:09 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:33:09 user nova-compute[73067]:       <nova:owner>
Aug 16 10:33:09 user nova-compute[73067]:         <nova:user uuid="b63f9ed0b5294eaf8919cf4c9bcea4ea">tempest-VolumesAdminNegativeTest-1324591370-project-member</nova:user>
Aug 16 10:33:09 user nova-compute[73067]:         <nova:project uuid="82e7f124a2a74ac482ff13de710ba04a">tempest-VolumesAdminNegativeTest-1324591370</nova:project>
Aug 16 10:33:09 user nova-compute[73067]:       </nova:owner>
Aug 16 10:33:09 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:33:09 user nova-compute[73067]:       <nova:ports>
Aug 16 10:33:09 user nova-compute[73067]:         <nova:port uuid="c96e297b-67f9-41f9-b396-87710eb267bc">
Aug 16 10:33:09 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 10:33:09 user nova-compute[73067]:         </nova:port>
Aug 16 10:33:09 user nova-compute[73067]:       </nova:ports>
Aug 16 10:33:09 user nova-compute[73067]:     </nova:instance>
Aug 16 10:33:09 user nova-compute[73067]:   </metadata>
Aug 16 10:33:09 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:33:09 user nova-compute[73067]:     <system>
Aug 16 10:33:09 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:33:09 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:33:09 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:33:09 user nova-compute[73067]:       <entry name="serial">f7014e03-d278-40cf-8a7b-c798d76c87b0</entry>
Aug 16 10:33:09 user nova-compute[73067]:       <entry name="uuid">f7014e03-d278-40cf-8a7b-c798d76c87b0</entry>
Aug 16 10:33:09 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:33:09 user nova-compute[73067]:     </system>
Aug 16 10:33:09 user nova-compute[73067]:   </sysinfo>
Aug 16 10:33:09 user nova-compute[73067]:   <os>
Aug 16 10:33:09 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:33:09 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:33:09 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:33:09 user nova-compute[73067]:   </os>
Aug 16 10:33:09 user nova-compute[73067]:   <features>
Aug 16 10:33:09 user nova-compute[73067]:     <acpi/>
Aug 16 10:33:09 user nova-compute[73067]:     <apic/>
Aug 16 10:33:09 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:33:09 user nova-compute[73067]:   </features>
Aug 16 10:33:09 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:33:09 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:33:09 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:33:09 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:33:09 user nova-compute[73067]:   </clock>
Aug 16 10:33:09 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:33:09 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:33:09 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:33:09 user nova-compute[73067]:   </cpu>
Aug 16 10:33:09 user nova-compute[73067]:   <devices>
Aug 16 10:33:09 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:33:09 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:33:09 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk"/>
Aug 16 10:33:09 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:33:09 user nova-compute[73067]:     </disk>
Aug 16 10:33:09 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:33:09 user nova-compute[73067]:       <mac address="fa:16:3e:97:29:19"/>
Aug 16 10:33:09 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:33:09 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:33:09 user nova-compute[73067]:       <target dev="tapc96e297b-67"/>
Aug 16 10:33:09 user nova-compute[73067]:     </interface>
Aug 16 10:33:09 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:33:09 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/console.log" append="off"/>
Aug 16 10:33:09 user nova-compute[73067]:     </serial>
Aug 16 10:33:09 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:33:09 user nova-compute[73067]:     <video>
Aug 16 10:33:09 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:33:09 user nova-compute[73067]:     </video>
Aug 16 10:33:09 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:33:09 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:33:09 user nova-compute[73067]:     </rng>
Aug 16 10:33:09 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:33:09 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:33:09 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:33:09 user nova-compute[73067]:     </memballoon>
Aug 16 10:33:09 user nova-compute[73067]:   </devices>
Aug 16 10:33:09 user nova-compute[73067]: </domain>
Aug 16 10:33:09 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-766796936',display_name='tempest-VolumesAdminNegativeTest-server-766796936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-766796936',id=14,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e7f124a2a74ac482ff13de710ba04a',ramdisk_id='',reservation_id='r-b2sbd78o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1324591370',owner_user_name='tempest-VolumesAdminNegativeTest-1324591370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:33:07Z,user_data=None,user_id='b63f9ed0b5294eaf8919cf4c9bcea4ea',uuid=f7014e03-d278-40cf-8a7b-c798d76c87b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c96e297b-67f9-41f9-b396-87710eb267bc", "address": "fa:16:3e:97:29:19", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96e297b-67", "ovs_interfaceid": "c96e297b-67f9-41f9-b396-87710eb267bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converting VIF {"id": "c96e297b-67f9-41f9-b396-87710eb267bc", "address": "fa:16:3e:97:29:19", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96e297b-67", "ovs_interfaceid": "c96e297b-67f9-41f9-b396-87710eb267bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:29:19,bridge_name='br-int',has_traffic_filtering=True,id=c96e297b-67f9-41f9-b396-87710eb267bc,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96e297b-67') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG os_vif [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:29:19,bridge_name='br-int',has_traffic_filtering=True,id=c96e297b-67f9-41f9-b396-87710eb267bc,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96e297b-67') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc96e297b-67, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc96e297b-67, col_values=(('external_ids', {'iface-id': 'c96e297b-67f9-41f9-b396-87710eb267bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:29:19', 'vm-uuid': 'f7014e03-d278-40cf-8a7b-c798d76c87b0'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:09 user nova-compute[73067]: INFO os_vif [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:29:19,bridge_name='br-int',has_traffic_filtering=True,id=c96e297b-67f9-41f9-b396-87710eb267bc,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96e297b-67')
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] No VIF found with MAC fa:16:3e:97:29:19, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.network.neutron [req-09b2f9bb-5608-41f0-9ce0-4a69419c53b8 req-4ca3b374-3b6c-49c4-ba11-dd6c600cb15f service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Updated VIF entry in instance network info cache for port c96e297b-67f9-41f9-b396-87710eb267bc. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG nova.network.neutron [req-09b2f9bb-5608-41f0-9ce0-4a69419c53b8 req-4ca3b374-3b6c-49c4-ba11-dd6c600cb15f service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Updating instance_info_cache with network_info: [{"id": "c96e297b-67f9-41f9-b396-87710eb267bc", "address": "fa:16:3e:97:29:19", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96e297b-67", "ovs_interfaceid": "c96e297b-67f9-41f9-b396-87710eb267bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-09b2f9bb-5608-41f0-9ce0-4a69419c53b8 req-4ca3b374-3b6c-49c4-ba11-dd6c600cb15f service nova] Releasing lock "refresh_cache-f7014e03-d278-40cf-8a7b-c798d76c87b0" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-f1d68977-9a89-4d4e-b348-29a35974e26e req-31812c45-33af-4e05-a0c5-d19684f9617f service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Received event network-vif-plugged-c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f1d68977-9a89-4d4e-b348-29a35974e26e req-31812c45-33af-4e05-a0c5-d19684f9617f service nova] Acquiring lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f1d68977-9a89-4d4e-b348-29a35974e26e req-31812c45-33af-4e05-a0c5-d19684f9617f service nova] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f1d68977-9a89-4d4e-b348-29a35974e26e req-31812c45-33af-4e05-a0c5-d19684f9617f service nova] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-f1d68977-9a89-4d4e-b348-29a35974e26e req-31812c45-33af-4e05-a0c5-d19684f9617f service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] No waiting events found dispatching network-vif-plugged-c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:11 user nova-compute[73067]: WARNING nova.compute.manager [req-f1d68977-9a89-4d4e-b348-29a35974e26e req-31812c45-33af-4e05-a0c5-d19684f9617f service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Received unexpected event network-vif-plugged-c96e297b-67f9-41f9-b396-87710eb267bc for instance with vm_state building and task_state spawning.
Aug 16 10:33:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "2f25b2a2-25fd-4146-abba-152967481a01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "2f25b2a2-25fd-4146-abba-152967481a01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:33:11 user nova-compute[73067]: INFO nova.compute.claims [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Claim successful on node user
Aug 16 10:33:11 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:33:12 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:33:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG nova.policy [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '586e0de6f261403fa757b2da4b578f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170bcb24cdf44e63ad5f42259b9c470c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:33:12 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Creating image(s)
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "/opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "/opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.168s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk 1073741824" returned: 0 in 0.057s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Successfully created port: 5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.218s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:33:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Cannot resize image /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lazy-loading 'migration_context' on Instance uuid 2f25b2a2-25fd-4146-abba-152967481a01 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Ensure instance console log exists: /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692181978.0294027, a050d0a6-0349-478a-8efc-fc4907ed20da => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:13 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] VM Stopped (Lifecycle Event)
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-23bfd6c7-bfc5-4962-81a9-ab0f8e8d71ee None None] [instance: a050d0a6-0349-478a-8efc-fc4907ed20da] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-16cefc6f-1952-4e93-9935-4dd14d408a36 req-79524344-8f95-4a8f-8474-139d05be7ed3 service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Received event network-vif-plugged-c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16cefc6f-1952-4e93-9935-4dd14d408a36 req-79524344-8f95-4a8f-8474-139d05be7ed3 service nova] Acquiring lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16cefc6f-1952-4e93-9935-4dd14d408a36 req-79524344-8f95-4a8f-8474-139d05be7ed3 service nova] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16cefc6f-1952-4e93-9935-4dd14d408a36 req-79524344-8f95-4a8f-8474-139d05be7ed3 service nova] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-16cefc6f-1952-4e93-9935-4dd14d408a36 req-79524344-8f95-4a8f-8474-139d05be7ed3 service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] No waiting events found dispatching network-vif-plugged-c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:13 user nova-compute[73067]: WARNING nova.compute.manager [req-16cefc6f-1952-4e93-9935-4dd14d408a36 req-79524344-8f95-4a8f-8474-139d05be7ed3 service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Received unexpected event network-vif-plugged-c96e297b-67f9-41f9-b396-87710eb267bc for instance with vm_state building and task_state spawning.
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181993.228835, f7014e03-d278-40cf-8a7b-c798d76c87b0 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:13 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] VM Resumed (Lifecycle Event)
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:33:13 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Instance spawned successfully.
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:13 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181993.2336676, f7014e03-d278-40cf-8a7b-c798d76c87b0 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:13 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] VM Started (Lifecycle Event)
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:33:13 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:33:13 user nova-compute[73067]: INFO nova.compute.manager [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 16 10:33:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:13 user nova-compute[73067]: INFO nova.compute.manager [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Took 7.43 seconds to build instance.
Aug 16 10:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0aeb1b30-cc3b-4690-8259-a4074c3ea6eb tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.553s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Successfully updated port: 5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "refresh_cache-2f25b2a2-25fd-4146-abba-152967481a01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquired lock "refresh_cache-2f25b2a2-25fd-4146-abba-152967481a01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Updating instance_info_cache with network_info: [{"id": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "address": "fa:16:3e:79:42:07", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5f8a13-d5", "ovs_interfaceid": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Releasing lock "refresh_cache-2f25b2a2-25fd-4146-abba-152967481a01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Instance network_info: |[{"id": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "address": "fa:16:3e:79:42:07", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5f8a13-d5", "ovs_interfaceid": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Start _get_guest_xml network_info=[{"id": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "address": "fa:16:3e:79:42:07", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5f8a13-d5", "ovs_interfaceid": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:33:14 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:33:14 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1515172778',display_name='tempest-VolumesActionsTest-instance-1515172778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1515172778',id=15,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='170bcb24cdf44e63ad5f42259b9c470c',ramdisk_id='',reservation_id='r-0xqfmsqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-811248869',owner_user_name='tempest-VolumesActionsTest-811248869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:33:12Z,user_data=None,user_id='586e0de6f261403fa757b2da4b578f8b',uuid=2f25b2a2-25fd-4146-abba-152967481a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "address": "fa:16:3e:79:42:07", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5f8a13-d5", "ovs_interfaceid": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converting VIF {"id": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "address": "fa:16:3e:79:42:07", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5f8a13-d5", "ovs_interfaceid": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:42:07,bridge_name='br-int',has_traffic_filtering=True,id=5d5f8a13-d5ea-4daf-89c7-379b5d8a05da,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5f8a13-d5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f25b2a2-25fd-4146-abba-152967481a01 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:33:14 user nova-compute[73067]:   <uuid>2f25b2a2-25fd-4146-abba-152967481a01</uuid>
Aug 16 10:33:14 user nova-compute[73067]:   <name>instance-0000000f</name>
Aug 16 10:33:14 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:33:14 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:33:14 user nova-compute[73067]:   <metadata>
Aug 16 10:33:14 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:33:14 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:33:14 user nova-compute[73067]:       <nova:name>tempest-VolumesActionsTest-instance-1515172778</nova:name>
Aug 16 10:33:14 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:33:14</nova:creationTime>
Aug 16 10:33:14 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:33:14 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:33:14 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:33:14 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:33:14 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:33:14 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:33:14 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:33:14 user nova-compute[73067]:       <nova:owner>
Aug 16 10:33:14 user nova-compute[73067]:         <nova:user uuid="586e0de6f261403fa757b2da4b578f8b">tempest-VolumesActionsTest-811248869-project-member</nova:user>
Aug 16 10:33:14 user nova-compute[73067]:         <nova:project uuid="170bcb24cdf44e63ad5f42259b9c470c">tempest-VolumesActionsTest-811248869</nova:project>
Aug 16 10:33:14 user nova-compute[73067]:       </nova:owner>
Aug 16 10:33:14 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:33:14 user nova-compute[73067]:       <nova:ports>
Aug 16 10:33:14 user nova-compute[73067]:         <nova:port uuid="5d5f8a13-d5ea-4daf-89c7-379b5d8a05da">
Aug 16 10:33:14 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 10:33:14 user nova-compute[73067]:         </nova:port>
Aug 16 10:33:14 user nova-compute[73067]:       </nova:ports>
Aug 16 10:33:14 user nova-compute[73067]:     </nova:instance>
Aug 16 10:33:14 user nova-compute[73067]:   </metadata>
Aug 16 10:33:14 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:33:14 user nova-compute[73067]:     <system>
Aug 16 10:33:14 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:33:14 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:33:14 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:33:14 user nova-compute[73067]:       <entry name="serial">2f25b2a2-25fd-4146-abba-152967481a01</entry>
Aug 16 10:33:14 user nova-compute[73067]:       <entry name="uuid">2f25b2a2-25fd-4146-abba-152967481a01</entry>
Aug 16 10:33:14 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:33:14 user nova-compute[73067]:     </system>
Aug 16 10:33:14 user nova-compute[73067]:   </sysinfo>
Aug 16 10:33:14 user nova-compute[73067]:   <os>
Aug 16 10:33:14 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:33:14 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:33:14 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:33:14 user nova-compute[73067]:   </os>
Aug 16 10:33:14 user nova-compute[73067]:   <features>
Aug 16 10:33:14 user nova-compute[73067]:     <acpi/>
Aug 16 10:33:14 user nova-compute[73067]:     <apic/>
Aug 16 10:33:14 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:33:14 user nova-compute[73067]:   </features>
Aug 16 10:33:14 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:33:14 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:33:14 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:33:14 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:33:14 user nova-compute[73067]:   </clock>
Aug 16 10:33:14 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:33:14 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:33:14 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:33:14 user nova-compute[73067]:   </cpu>
Aug 16 10:33:14 user nova-compute[73067]:   <devices>
Aug 16 10:33:14 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:33:14 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:33:14 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk"/>
Aug 16 10:33:14 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:33:14 user nova-compute[73067]:     </disk>
Aug 16 10:33:14 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:33:14 user nova-compute[73067]:       <mac address="fa:16:3e:79:42:07"/>
Aug 16 10:33:14 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:33:14 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:33:14 user nova-compute[73067]:       <target dev="tap5d5f8a13-d5"/>
Aug 16 10:33:14 user nova-compute[73067]:     </interface>
Aug 16 10:33:14 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:33:14 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/console.log" append="off"/>
Aug 16 10:33:14 user nova-compute[73067]:     </serial>
Aug 16 10:33:14 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:33:14 user nova-compute[73067]:     <video>
Aug 16 10:33:14 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:33:14 user nova-compute[73067]:     </video>
Aug 16 10:33:14 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:33:14 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:33:14 user nova-compute[73067]:     </rng>
Aug 16 10:33:14 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:33:14 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:33:14 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:33:14 user nova-compute[73067]:     </memballoon>
Aug 16 10:33:14 user nova-compute[73067]:   </devices>
Aug 16 10:33:14 user nova-compute[73067]: </domain>
Aug 16 10:33:14 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1515172778',display_name='tempest-VolumesActionsTest-instance-1515172778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1515172778',id=15,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='170bcb24cdf44e63ad5f42259b9c470c',ramdisk_id='',reservation_id='r-0xqfmsqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-811248869',owner_user_name='tempest-VolumesActionsTest-811248869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:33:12Z,user_data=None,user_id='586e0de6f261403fa757b2da4b578f8b',uuid=2f25b2a2-25fd-4146-abba-152967481a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "address": "fa:16:3e:79:42:07", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5f8a13-d5", "ovs_interfaceid": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converting VIF {"id": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "address": "fa:16:3e:79:42:07", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5f8a13-d5", "ovs_interfaceid": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:42:07,bridge_name='br-int',has_traffic_filtering=True,id=5d5f8a13-d5ea-4daf-89c7-379b5d8a05da,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5f8a13-d5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_vif [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:42:07,bridge_name='br-int',has_traffic_filtering=True,id=5d5f8a13-d5ea-4daf-89c7-379b5d8a05da,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5f8a13-d5') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d5f8a13-d5, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d5f8a13-d5, col_values=(('external_ids', {'iface-id': '5d5f8a13-d5ea-4daf-89c7-379b5d8a05da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:42:07', 'vm-uuid': '2f25b2a2-25fd-4146-abba-152967481a01'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:14 user nova-compute[73067]: INFO os_vif [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:42:07,bridge_name='br-int',has_traffic_filtering=True,id=5d5f8a13-d5ea-4daf-89c7-379b5d8a05da,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5f8a13-d5')
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBVIGDSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:33:14 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:33:14 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:33:14 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] No VIF found with MAC fa:16:3e:79:42:07, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2a3c71-7cfa-469b-ad15-b98e6747bab8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:33:14 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9313b66f-1e26-4b87-9a5e-4db330a3cfe7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3] added
Aug 16 10:33:14 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c820cc-c584-4d15-9cfe-70a19f0642ba]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40324c5-5533-44bc-8445-1098c3d9baf8]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBVIGDSa {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBVIGDSa" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e389d4a7-6313-49a6-b733-99a51c0037c6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBVIGDSa'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a9bda3-8d07-43a8-9f9b-6d463355fb9f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e9e857-d089-4101-b08c-c8515ef33884]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:33:15 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:15 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:33:15 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:15 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb5c78e-7341-4884-8740-5124795b97f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3, portal: 172.16.0.220,3260]
Aug 16 10:33:15 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3, portal: 172.16.0.220,3260] successful.
Aug 16 10:33:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5992272f-5dc7-4720-9c83-9ea865c5a45d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6175cad-7fde-4b32-a170-68533fb544c5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:15 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:33:15 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:15 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:15 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:33:15 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:15 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[046ce0e4-38f5-4fb2-acc1-29c5cf9cccec]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-b913cd5f-58aa-4736-ad6f-cdc6b664f120 req-05c9218e-4a6f-4ca2-89b1-39d6f1dabffe service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Received event network-changed-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-b913cd5f-58aa-4736-ad6f-cdc6b664f120 req-05c9218e-4a6f-4ca2-89b1-39d6f1dabffe service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Refreshing instance network info cache due to event network-changed-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b913cd5f-58aa-4736-ad6f-cdc6b664f120 req-05c9218e-4a6f-4ca2-89b1-39d6f1dabffe service nova] Acquiring lock "refresh_cache-2f25b2a2-25fd-4146-abba-152967481a01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b913cd5f-58aa-4736-ad6f-cdc6b664f120 req-05c9218e-4a6f-4ca2-89b1-39d6f1dabffe service nova] Acquired lock "refresh_cache-2f25b2a2-25fd-4146-abba-152967481a01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG nova.network.neutron [req-b913cd5f-58aa-4736-ad6f-cdc6b664f120 req-05c9218e-4a6f-4ca2-89b1-39d6f1dabffe service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Refreshing network info cache for port 5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Acquiring lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Acquiring lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:15 user nova-compute[73067]: INFO nova.compute.manager [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Terminating instance
Aug 16 10:33:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBVIGDSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23831653930613339', 'path': '/dev/sdd'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831653930613339', 'path': '/dev/sdd'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.objects.instance [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'flavor' on Instance uuid b8758033-0b89-4953-b96b-0dc227bb3a3d {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:33:16 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:33:16 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 10:33:16 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:33:16 user nova-compute[73067]:   <serial>91da7944-7fb3-409f-be3d-615f989058d3</serial>
Aug 16 10:33:16 user nova-compute[73067]: </disk>
Aug 16 10:33:16 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.network.neutron [req-b913cd5f-58aa-4736-ad6f-cdc6b664f120 req-05c9218e-4a6f-4ca2-89b1-39d6f1dabffe service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Updated VIF entry in instance network info cache for port 5d5f8a13-d5ea-4daf-89c7-379b5d8a05da. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.network.neutron [req-b913cd5f-58aa-4736-ad6f-cdc6b664f120 req-05c9218e-4a6f-4ca2-89b1-39d6f1dabffe service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Updating instance_info_cache with network_info: [{"id": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "address": "fa:16:3e:79:42:07", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5f8a13-d5", "ovs_interfaceid": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b913cd5f-58aa-4736-ad6f-cdc6b664f120 req-05c9218e-4a6f-4ca2-89b1-39d6f1dabffe service nova] Releasing lock "refresh_cache-2f25b2a2-25fd-4146-abba-152967481a01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Instance destroyed successfully.
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.objects.instance [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lazy-loading 'resources' on Instance uuid 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1110878826',display_name='tempest-VolumesAssistedSnapshotsTest-server-1110878826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1110878826',id=7,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgvttldZutgpZ6Dj5zEj2++7tPL1cgZ/s4PKaNzjPiJIvPuU4eeXwkUn0Z5t6gEWNkDeBDfC1knQqdn4uAgd+0hd1VblBC5EyhdJ8kLil2w804CQhs8bd2MduCTUMK8/w==',key_name='tempest-keypair-1802283716',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='026fa602bff1432596eb8c422511b442',ramdisk_id='',reservation_id='r-0f5b4ma4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1791340926',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1791340926-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:30:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c7ff62bc4a84ea393759c679ca46a2b',uuid=6b5d4dbc-c660-4b40-81cd-871dfcaa9130,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Converting VIF {"id": "32c89e72-0827-416a-b000-48ae3fcef088", "address": "fa:16:3e:5c:82:f8", "network": {"id": "b41d4b89-80e7-46be-a87a-89b900fe0855", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1689999528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fa602bff1432596eb8c422511b442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c89e72-08", "ovs_interfaceid": "32c89e72-0827-416a-b000-48ae3fcef088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:82:f8,bridge_name='br-int',has_traffic_filtering=True,id=32c89e72-0827-416a-b000-48ae3fcef088,network=Network(b41d4b89-80e7-46be-a87a-89b900fe0855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c89e72-08') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG os_vif [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:82:f8,bridge_name='br-int',has_traffic_filtering=True,id=32c89e72-0827-416a-b000-48ae3fcef088,network=Network(b41d4b89-80e7-46be-a87a-89b900fe0855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c89e72-08') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c89e72-08, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:16 user nova-compute[73067]: INFO os_vif [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:82:f8,bridge_name='br-int',has_traffic_filtering=True,id=32c89e72-0827-416a-b000-48ae3fcef088,network=Network(b41d4b89-80e7-46be-a87a-89b900fe0855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c89e72-08')
Aug 16 10:33:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Deleting instance files /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130_del
Aug 16 10:33:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Deletion of /opt/stack/data/nova/instances/6b5d4dbc-c660-4b40-81cd-871dfcaa9130_del complete
Aug 16 10:33:16 user nova-compute[73067]: INFO nova.compute.manager [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 16 10:33:16 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:33:16 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] No VIF found with MAC fa:16:3e:a3:de:c6, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-b3213488-3737-4a57-b87b-ade469c43e19 req-66c91a29-d194-4601-b1d7-ac68b6782f20 service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Received event network-vif-plugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b3213488-3737-4a57-b87b-ade469c43e19 req-66c91a29-d194-4601-b1d7-ac68b6782f20 service nova] Acquiring lock "2f25b2a2-25fd-4146-abba-152967481a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b3213488-3737-4a57-b87b-ade469c43e19 req-66c91a29-d194-4601-b1d7-ac68b6782f20 service nova] Lock "2f25b2a2-25fd-4146-abba-152967481a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b3213488-3737-4a57-b87b-ade469c43e19 req-66c91a29-d194-4601-b1d7-ac68b6782f20 service nova] Lock "2f25b2a2-25fd-4146-abba-152967481a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-b3213488-3737-4a57-b87b-ade469c43e19 req-66c91a29-d194-4601-b1d7-ac68b6782f20 service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] No waiting events found dispatching network-vif-plugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:17 user nova-compute[73067]: WARNING nova.compute.manager [req-b3213488-3737-4a57-b87b-ade469c43e19 req-66c91a29-d194-4601-b1d7-ac68b6782f20 service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Received unexpected event network-vif-plugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da for instance with vm_state building and task_state spawning.
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08ba74ce-e4d7-4708-baa9-743cf936f1c9 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.754s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received event network-vif-unplugged-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] Acquiring lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] No waiting events found dispatching network-vif-unplugged-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received event network-vif-unplugged-32c89e72-0827-416a-b000-48ae3fcef088 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received event network-vif-plugged-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] Acquiring lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] No waiting events found dispatching network-vif-plugged-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:17 user nova-compute[73067]: WARNING nova.compute.manager [req-90f35cbb-e5fc-4910-810e-52486d6c2316 req-afe42ce0-9f82-4489-a15d-10801c5346eb service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received unexpected event network-vif-plugged-32c89e72-0827-416a-b000-48ae3fcef088 for instance with vm_state active and task_state deleting.
Aug 16 10:33:17 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:17 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Took 1.03 seconds to deallocate network for instance.
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:18 user nova-compute[73067]: INFO nova.compute.manager [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Terminating instance
Aug 16 10:33:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:18 user nova-compute[73067]: INFO nova.compute.manager [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Terminating instance
Aug 16 10:33:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.080s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Deleted allocations for instance 6b5d4dbc-c660-4b40-81cd-871dfcaa9130
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-a6641743-b48b-44c8-a4c9-bbe28a90e830 req-785a6f7d-1f4c-48e4-b7d6-a18d6a7a78a6 service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Received event network-vif-plugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a6641743-b48b-44c8-a4c9-bbe28a90e830 req-785a6f7d-1f4c-48e4-b7d6-a18d6a7a78a6 service nova] Acquiring lock "2f25b2a2-25fd-4146-abba-152967481a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a6641743-b48b-44c8-a4c9-bbe28a90e830 req-785a6f7d-1f4c-48e4-b7d6-a18d6a7a78a6 service nova] Lock "2f25b2a2-25fd-4146-abba-152967481a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a6641743-b48b-44c8-a4c9-bbe28a90e830 req-785a6f7d-1f4c-48e4-b7d6-a18d6a7a78a6 service nova] Lock "2f25b2a2-25fd-4146-abba-152967481a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-a6641743-b48b-44c8-a4c9-bbe28a90e830 req-785a6f7d-1f4c-48e4-b7d6-a18d6a7a78a6 service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] No waiting events found dispatching network-vif-plugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:19 user nova-compute[73067]: WARNING nova.compute.manager [req-a6641743-b48b-44c8-a4c9-bbe28a90e830 req-785a6f7d-1f4c-48e4-b7d6-a18d6a7a78a6 service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Received unexpected event network-vif-plugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da for instance with vm_state building and task_state spawning.
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1031402d-b475-41e0-b3fe-83168e19b36c tempest-VolumesAssistedSnapshotsTest-1791340926 tempest-VolumesAssistedSnapshotsTest-1791340926-project-member] Lock "6b5d4dbc-c660-4b40-81cd-871dfcaa9130" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.034s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Instance destroyed successfully.
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.objects.instance [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lazy-loading 'resources' on Instance uuid 65299891-9731-4b3b-b23e-85813d45eb58 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Instance destroyed successfully.
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.objects.instance [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lazy-loading 'resources' on Instance uuid 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-549440583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-549440583',id=8,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/ET4f+GadAJ2XEk1G0bW3MJhSK9fZRqno/3i6IGeLmLpNdtSstzLjv1zvrKcBm/cTzruDBnMijgSTFRsgfXO1gSW064pzF0QTVeNoDA8Zd2epUz5KDmPX2yAUQRp8fNw==',key_name='tempest-keypair-1652680034',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78fc4d3a3d3249259022dc9de8015725',ramdisk_id='',reservation_id='r-sc8f08j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-632372241',owner_user_name='tempest-TaggedAttachmentsTest-632372241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77535d32f7044acb9972a0dea8b2d882',uuid=65299891-9731-4b3b-b23e-85813d45eb58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converting VIF {"id": "185f299d-2471-4692-9ead-a478e312f02e", "address": "fa:16:3e:62:c9:de", "network": {"id": "59243067-6bb6-426b-8fc9-e2eed1a2808e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1123223894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78fc4d3a3d3249259022dc9de8015725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap185f299d-24", "ovs_interfaceid": "185f299d-2471-4692-9ead-a478e312f02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:c9:de,bridge_name='br-int',has_traffic_filtering=True,id=185f299d-2471-4692-9ead-a478e312f02e,network=Network(59243067-6bb6-426b-8fc9-e2eed1a2808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185f299d-24') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG os_vif [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:c9:de,bridge_name='br-int',has_traffic_filtering=True,id=185f299d-2471-4692-9ead-a478e312f02e,network=Network(59243067-6bb6-426b-8fc9-e2eed1a2808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185f299d-24') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap185f299d-24, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2059202362',display_name='tempest-ServersNegativeTestJSON-server-2059202362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2059202362',id=13,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c56c1ffc9f4b4b63a31c6020cdc12f96',ramdisk_id='',reservation_id='r-zfp0011a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-29460834',owner_user_name='tempest-ServersNegativeTestJSON-29460834-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:35Z,user_data=None,user_id='7c965df8f8c240438581033b9004bea3',uuid=4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "address": "fa:16:3e:fb:5a:de", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd3051a-5d", "ovs_interfaceid": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converting VIF {"id": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "address": "fa:16:3e:fb:5a:de", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd3051a-5d", "ovs_interfaceid": "7bd3051a-5dc0-49c2-8f7c-453aaf11590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=7bd3051a-5dc0-49c2-8f7c-453aaf11590e,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd3051a-5d') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG os_vif [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=7bd3051a-5dc0-49c2-8f7c-453aaf11590e,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd3051a-5d') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bd3051a-5d, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: INFO os_vif [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:c9:de,bridge_name='br-int',has_traffic_filtering=True,id=185f299d-2471-4692-9ead-a478e312f02e,network=Network(59243067-6bb6-426b-8fc9-e2eed1a2808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185f299d-24')
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Deleting instance files /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58_del
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Deletion of /opt/stack/data/nova/instances/65299891-9731-4b3b-b23e-85813d45eb58_del complete
Aug 16 10:33:19 user nova-compute[73067]: INFO os_vif [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=7bd3051a-5dc0-49c2-8f7c-453aaf11590e,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd3051a-5d')
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Deleting instance files /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5_del
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Deletion of /opt/stack/data/nova/instances/4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5_del complete
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-af2e6abf-043a-4e48-9106-ec4850a05c6b req-219e305d-175f-4ad8-97c7-c61f86d4f361 service nova] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Received event network-vif-deleted-32c89e72-0827-416a-b000-48ae3fcef088 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.compute.manager [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 16 10:33:19 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.compute.manager [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Took 1.56 seconds to destroy the instance on the hypervisor.
Aug 16 10:33:19 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181999.9680533, 2f25b2a2-25fd-4146-abba-152967481a01 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] VM Resumed (Lifecycle Event)
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:33:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Instance spawned successfully.
Aug 16 10:33:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:20 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692181999.969506, 2f25b2a2-25fd-4146-abba-152967481a01 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:20 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] VM Started (Lifecycle Event)
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:33:20 user nova-compute[73067]: INFO nova.compute.manager [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Took 7.99 seconds to spawn the instance on the hypervisor.
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:20 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:33:20 user nova-compute[73067]: INFO nova.compute.manager [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Took 8.84 seconds to build instance.
Aug 16 10:33:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ff91fda3-4777-4c76-a807-e5d56d438f6b tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "2f25b2a2-25fd-4146-abba-152967481a01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.966s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:20 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:20 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Took 1.36 seconds to deallocate network for instance.
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Received event network-vif-unplugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] Acquiring lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] No waiting events found dispatching network-vif-unplugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:21 user nova-compute[73067]: WARNING nova.compute.manager [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Received unexpected event network-vif-unplugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e for instance with vm_state deleted and task_state None.
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Received event network-vif-plugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] Acquiring lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] No waiting events found dispatching network-vif-plugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:21 user nova-compute[73067]: WARNING nova.compute.manager [req-a1f693e3-554a-4c88-9d55-8146d9380e41 req-e920756e-2841-4540-8750-3421e82d1bce service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Received unexpected event network-vif-plugged-7bd3051a-5dc0-49c2-8f7c-453aaf11590e for instance with vm_state deleted and task_state None.
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:21 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Deleted allocations for instance 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5
Aug 16 10:33:21 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Took 2.02 seconds to deallocate network for instance.
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-77e420ee-4f74-4e8a-8f13-00d942d4fc75 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.492s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-unplugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] No waiting events found dispatching network-vif-unplugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:21 user nova-compute[73067]: WARNING nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received unexpected event network-vif-unplugged-185f299d-2471-4692-9ead-a478e312f02e for instance with vm_state deleted and task_state None.
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] No waiting events found dispatching network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:21 user nova-compute[73067]: WARNING nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received unexpected event network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e for instance with vm_state deleted and task_state None.
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] No waiting events found dispatching network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:21 user nova-compute[73067]: WARNING nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received unexpected event network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e for instance with vm_state deleted and task_state None.
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Received event network-vif-deleted-7bd3051a-5dc0-49c2-8f7c-453aaf11590e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Acquiring lock "65299891-9731-4b3b-b23e-85813d45eb58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] Lock "65299891-9731-4b3b-b23e-85813d45eb58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] No waiting events found dispatching network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:21 user nova-compute[73067]: WARNING nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received unexpected event network-vif-plugged-185f299d-2471-4692-9ead-a478e312f02e for instance with vm_state deleted and task_state None.
Aug 16 10:33:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-bda50572-8855-41c0-a5aa-3d17151bcc25 req-b3220662-9858-45e5-8a37-d3a6ea8df0df service nova] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Received event network-vif-deleted-185f299d-2471-4692-9ead-a478e312f02e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:22 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:33:22 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:33:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:22 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Deleted allocations for instance 65299891-9731-4b3b-b23e-85813d45eb58
Aug 16 10:33:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85df4535-73e9-4f5e-87aa-c0ffedc77709 tempest-TaggedAttachmentsTest-632372241 tempest-TaggedAttachmentsTest-632372241-project-member] Lock "65299891-9731-4b3b-b23e-85813d45eb58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.177s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG nova.objects.instance [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'flavor' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:27 user nova-compute[73067]: INFO nova.compute.manager [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Attaching volume 8b6534b8-33c4-4781-9a17-ead5b83f893b to /dev/vdb
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG os_brick.utils [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e230edd6-ed36-4d53-a1d7-3793960bec5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feebca8-6c3b-4cd0-9279-52c219e49847]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50059be-72ea-4b76-8dfd-047887b3f923]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4698bf-d6f5-48ab-81ec-157038e82666]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:33:28 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[463d19c1-a78d-4dda-acf8-de378c09938c]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG os_brick.utils [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updating existing volume attachment record: e7c7c47f-d86b-4f77-bf8f-fcdd2f11cafb {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:33:29 user nova-compute[73067]: INFO nova.compute.claims [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Claim successful on node user
Aug 16 10:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:30 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:33:30 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7676MB free_disk=25.668949127197266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.035s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.335s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.network.neutron [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b51879a0-d5a1-4f96-b0c1-0672d31e80db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b8758033-0b89-4953-b96b-0dc227bb3a3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f7014e03-d278-40cf-8a7b-c798d76c87b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 2f25b2a2-25fd-4146-abba-152967481a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ffe1f07d-0a48-431d-be98-7e78018faa10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:33:30 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:33:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG nova.policy [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e4cbf9cec1c4c438adbbab6bd7f794c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7b37f1cdfe41ddb6545c23a5b5c8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:33:31 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Creating image(s)
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "/opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "/opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.218s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk 1073741824" returned: 0 in 0.097s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692181996.5725663, 6b5d4dbc-c660-4b40-81cd-871dfcaa9130 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:31 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] VM Stopped (Lifecycle Event)
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-07c6ea25-3683-4ea7-ab50-1d0df43c0306 None None] [instance: 6b5d4dbc-c660-4b40-81cd-871dfcaa9130] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.197s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Cannot resize image /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG nova.objects.instance [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'migration_context' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Ensure instance console log exists: /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Successfully created port: f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updating instance_info_cache with network_info: [{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Successfully updated port: f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquired lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-5fe2e787-1b15-449a-a166-11692576f3b6 req-5e0c3fda-e476-43f4-9fdf-80c53797f1b5 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-changed-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-5fe2e787-1b15-449a-a166-11692576f3b6 req-5e0c3fda-e476-43f4-9fdf-80c53797f1b5 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Refreshing instance network info cache due to event network-changed-f4af474f-c83b-403b-abed-abaf9c0e71f8. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5fe2e787-1b15-449a-a166-11692576f3b6 req-5e0c3fda-e476-43f4-9fdf-80c53797f1b5 service nova] Acquiring lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.network.neutron [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.network.neutron [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Updating instance_info_cache with network_info: [{"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Releasing lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Instance network_info: |[{"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5fe2e787-1b15-449a-a166-11692576f3b6 req-5e0c3fda-e476-43f4-9fdf-80c53797f1b5 service nova] Acquired lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.network.neutron [req-5fe2e787-1b15-449a-a166-11692576f3b6 req-5e0c3fda-e476-43f4-9fdf-80c53797f1b5 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Refreshing network info cache for port f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Start _get_guest_xml network_info=[{"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692181999.4631255, 65299891-9731-4b3b-b23e-85813d45eb58 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:34 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] VM Stopped (Lifecycle Event)
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692181999.4646688, 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:34 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] VM Stopped (Lifecycle Event)
Aug 16 10:33:34 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:33:34 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-3da9d37a-466f-4a6d-b5d3-1f8036d91090 None None] [instance: 4bf0b6de-f9ba-428d-b7e8-5605f6d96cb5] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-474030065',display_name='tempest-tempest.common.compute-instance-474030065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-474030065',id=16,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSwseBSIzKQEmuDvq8Hdi2xgXNDpzTwGm6gMW/fO7+s7B2Iv2Dv1yoN6p8FMkcmuvxctndByirO8QFQRXIfhiELJwq44/dD13T3UEuod/ThSU86msaJkBUM3PERa3slQQ==',key_name='tempest-keypair-433429582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-4xf1pl3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=ffe1f07d-0a48-431d-be98-7e78018faa10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.objects.instance [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'pci_devices' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-76aadfbf-b788-4911-b9c7-5ef442efae03 None None] [instance: 65299891-9731-4b3b-b23e-85813d45eb58] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:33:34 user nova-compute[73067]:   <uuid>ffe1f07d-0a48-431d-be98-7e78018faa10</uuid>
Aug 16 10:33:34 user nova-compute[73067]:   <name>instance-00000010</name>
Aug 16 10:33:34 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:33:34 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:33:34 user nova-compute[73067]:   <metadata>
Aug 16 10:33:34 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:33:34 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:33:34 user nova-compute[73067]:       <nova:name>tempest-tempest.common.compute-instance-474030065</nova:name>
Aug 16 10:33:34 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:33:34</nova:creationTime>
Aug 16 10:33:34 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:33:34 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:33:34 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:33:34 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:33:34 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:33:34 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:33:34 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:33:34 user nova-compute[73067]:       <nova:owner>
Aug 16 10:33:34 user nova-compute[73067]:         <nova:user uuid="9e4cbf9cec1c4c438adbbab6bd7f794c">tempest-ServerActionsTestOtherA-1833692287-project-member</nova:user>
Aug 16 10:33:34 user nova-compute[73067]:         <nova:project uuid="1b7b37f1cdfe41ddb6545c23a5b5c8b4">tempest-ServerActionsTestOtherA-1833692287</nova:project>
Aug 16 10:33:34 user nova-compute[73067]:       </nova:owner>
Aug 16 10:33:34 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:33:34 user nova-compute[73067]:       <nova:ports>
Aug 16 10:33:34 user nova-compute[73067]:         <nova:port uuid="f4af474f-c83b-403b-abed-abaf9c0e71f8">
Aug 16 10:33:34 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 10:33:34 user nova-compute[73067]:         </nova:port>
Aug 16 10:33:34 user nova-compute[73067]:       </nova:ports>
Aug 16 10:33:34 user nova-compute[73067]:     </nova:instance>
Aug 16 10:33:34 user nova-compute[73067]:   </metadata>
Aug 16 10:33:34 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:33:34 user nova-compute[73067]:     <system>
Aug 16 10:33:34 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:33:34 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:33:34 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:33:34 user nova-compute[73067]:       <entry name="serial">ffe1f07d-0a48-431d-be98-7e78018faa10</entry>
Aug 16 10:33:34 user nova-compute[73067]:       <entry name="uuid">ffe1f07d-0a48-431d-be98-7e78018faa10</entry>
Aug 16 10:33:34 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:33:34 user nova-compute[73067]:     </system>
Aug 16 10:33:34 user nova-compute[73067]:   </sysinfo>
Aug 16 10:33:34 user nova-compute[73067]:   <os>
Aug 16 10:33:34 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:33:34 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:33:34 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:33:34 user nova-compute[73067]:   </os>
Aug 16 10:33:34 user nova-compute[73067]:   <features>
Aug 16 10:33:34 user nova-compute[73067]:     <acpi/>
Aug 16 10:33:34 user nova-compute[73067]:     <apic/>
Aug 16 10:33:34 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:33:34 user nova-compute[73067]:   </features>
Aug 16 10:33:34 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:33:34 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:33:34 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:33:34 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:33:34 user nova-compute[73067]:   </clock>
Aug 16 10:33:34 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:33:34 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:33:34 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:33:34 user nova-compute[73067]:   </cpu>
Aug 16 10:33:34 user nova-compute[73067]:   <devices>
Aug 16 10:33:34 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:33:34 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:33:34 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk"/>
Aug 16 10:33:34 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:33:34 user nova-compute[73067]:     </disk>
Aug 16 10:33:34 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:33:34 user nova-compute[73067]:       <mac address="fa:16:3e:58:69:43"/>
Aug 16 10:33:34 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:33:34 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:33:34 user nova-compute[73067]:       <target dev="tapf4af474f-c8"/>
Aug 16 10:33:34 user nova-compute[73067]:     </interface>
Aug 16 10:33:34 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:33:34 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/console.log" append="off"/>
Aug 16 10:33:34 user nova-compute[73067]:     </serial>
Aug 16 10:33:34 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:33:34 user nova-compute[73067]:     <video>
Aug 16 10:33:34 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:33:34 user nova-compute[73067]:     </video>
Aug 16 10:33:34 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:33:34 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:33:34 user nova-compute[73067]:     </rng>
Aug 16 10:33:34 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:33:34 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:33:34 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:33:34 user nova-compute[73067]:     </memballoon>
Aug 16 10:33:34 user nova-compute[73067]:   </devices>
Aug 16 10:33:34 user nova-compute[73067]: </domain>
Aug 16 10:33:34 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-474030065',display_name='tempest-tempest.common.compute-instance-474030065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-474030065',id=16,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSwseBSIzKQEmuDvq8Hdi2xgXNDpzTwGm6gMW/fO7+s7B2Iv2Dv1yoN6p8FMkcmuvxctndByirO8QFQRXIfhiELJwq44/dD13T3UEuod/ThSU86msaJkBUM3PERa3slQQ==',key_name='tempest-keypair-433429582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-4xf1pl3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=ffe1f07d-0a48-431d-be98-7e78018faa10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG os_vif [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4af474f-c8, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4af474f-c8, col_values=(('external_ids', {'iface-id': 'f4af474f-c83b-403b-abed-abaf9c0e71f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:69:43', 'vm-uuid': 'ffe1f07d-0a48-431d-be98-7e78018faa10'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:34 user nova-compute[73067]: INFO os_vif [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8')
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No VIF found with MAC fa:16:3e:58:69:43, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:33:35 user nova-compute[73067]: DEBUG nova.network.neutron [req-5fe2e787-1b15-449a-a166-11692576f3b6 req-5e0c3fda-e476-43f4-9fdf-80c53797f1b5 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Updated VIF entry in instance network info cache for port f4af474f-c83b-403b-abed-abaf9c0e71f8. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:33:35 user nova-compute[73067]: DEBUG nova.network.neutron [req-5fe2e787-1b15-449a-a166-11692576f3b6 req-5e0c3fda-e476-43f4-9fdf-80c53797f1b5 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Updating instance_info_cache with network_info: [{"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5fe2e787-1b15-449a-a166-11692576f3b6 req-5e0c3fda-e476-43f4-9fdf-80c53797f1b5 service nova] Releasing lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-333d8b46-8147-4196-a09f-358f82187900 req-6e89fbb1-6e18-4453-8ba6-65d8a262f852 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-333d8b46-8147-4196-a09f-358f82187900 req-6e89fbb1-6e18-4453-8ba6-65d8a262f852 service nova] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-333d8b46-8147-4196-a09f-358f82187900 req-6e89fbb1-6e18-4453-8ba6-65d8a262f852 service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-333d8b46-8147-4196-a09f-358f82187900 req-6e89fbb1-6e18-4453-8ba6-65d8a262f852 service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-333d8b46-8147-4196-a09f-358f82187900 req-6e89fbb1-6e18-4453-8ba6-65d8a262f852 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] No waiting events found dispatching network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:37 user nova-compute[73067]: WARNING nova.compute.manager [req-333d8b46-8147-4196-a09f-358f82187900 req-6e89fbb1-6e18-4453-8ba6-65d8a262f852 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received unexpected event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 for instance with vm_state building and task_state spawning.
Aug 16 10:33:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-716bb6ee-6e20-43ea-a148-9720778b4ac5 req-05724eb8-0f9e-41df-a5a1-0acfb5c4495e service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-changed-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-716bb6ee-6e20-43ea-a148-9720778b4ac5 req-05724eb8-0f9e-41df-a5a1-0acfb5c4495e service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing instance network info cache due to event network-changed-008c71c2-37af-4e5c-bc2a-bdf5d684595f. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:33:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-716bb6ee-6e20-43ea-a148-9720778b4ac5 req-05724eb8-0f9e-41df-a5a1-0acfb5c4495e service nova] Acquiring lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-716bb6ee-6e20-43ea-a148-9720778b4ac5 req-05724eb8-0f9e-41df-a5a1-0acfb5c4495e service nova] Acquired lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:37 user nova-compute[73067]: DEBUG nova.network.neutron [req-716bb6ee-6e20-43ea-a148-9720778b4ac5 req-05724eb8-0f9e-41df-a5a1-0acfb5c4495e service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Refreshing network info cache for port 008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:33:38 user nova-compute[73067]: DEBUG nova.network.neutron [req-716bb6ee-6e20-43ea-a148-9720778b4ac5 req-05724eb8-0f9e-41df-a5a1-0acfb5c4495e service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updated VIF entry in instance network info cache for port 008c71c2-37af-4e5c-bc2a-bdf5d684595f. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:33:38 user nova-compute[73067]: DEBUG nova.network.neutron [req-716bb6ee-6e20-43ea-a148-9720778b4ac5 req-05724eb8-0f9e-41df-a5a1-0acfb5c4495e service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [{"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-716bb6ee-6e20-43ea-a148-9720778b4ac5 req-05724eb8-0f9e-41df-a5a1-0acfb5c4495e service nova] Releasing lock "refresh_cache-11f1d48e-6575-46e8-87a7-ab9defb8a7d7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:33:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:33:38 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182018.9802475, ffe1f07d-0a48-431d-be98-7e78018faa10 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:38 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] VM Resumed (Lifecycle Event)
Aug 16 10:33:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Instance spawned successfully.
Aug 16 10:33:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:33:39 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182018.9813735, ffe1f07d-0a48-431d-be98-7e78018faa10 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:39 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] VM Started (Lifecycle Event)
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-bac53658-c344-4d9a-9dff-3e84c30433e0 req-81501841-c9f1-4dfc-812a-3b41ce6e676c service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bac53658-c344-4d9a-9dff-3e84c30433e0 req-81501841-c9f1-4dfc-812a-3b41ce6e676c service nova] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bac53658-c344-4d9a-9dff-3e84c30433e0 req-81501841-c9f1-4dfc-812a-3b41ce6e676c service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bac53658-c344-4d9a-9dff-3e84c30433e0 req-81501841-c9f1-4dfc-812a-3b41ce6e676c service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-bac53658-c344-4d9a-9dff-3e84c30433e0 req-81501841-c9f1-4dfc-812a-3b41ce6e676c service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] No waiting events found dispatching network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:39 user nova-compute[73067]: WARNING nova.compute.manager [req-bac53658-c344-4d9a-9dff-3e84c30433e0 req-81501841-c9f1-4dfc-812a-3b41ce6e676c service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received unexpected event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 for instance with vm_state building and task_state spawning.
Aug 16 10:33:39 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:33:39 user nova-compute[73067]: INFO nova.compute.manager [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Took 8.09 seconds to spawn the instance on the hypervisor.
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:39 user nova-compute[73067]: INFO nova.compute.manager [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Took 9.72 seconds to build instance.
Aug 16 10:33:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-15e061bb-9e41-4f75-8ea3-3d879b006574 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.910s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:39 user nova-compute[73067]: INFO nova.compute.manager [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Terminating instance
Aug 16 10:33:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-6f6bead1-df64-4953-b9cb-e375aa855d7b req-3774f3f4-8b38-4e02-83fc-85d44605d5ab service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6f6bead1-df64-4953-b9cb-e375aa855d7b req-3774f3f4-8b38-4e02-83fc-85d44605d5ab service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6f6bead1-df64-4953-b9cb-e375aa855d7b req-3774f3f4-8b38-4e02-83fc-85d44605d5ab service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6f6bead1-df64-4953-b9cb-e375aa855d7b req-3774f3f4-8b38-4e02-83fc-85d44605d5ab service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-6f6bead1-df64-4953-b9cb-e375aa855d7b req-3774f3f4-8b38-4e02-83fc-85d44605d5ab service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-unplugged-32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-6f6bead1-df64-4953-b9cb-e375aa855d7b req-3774f3f4-8b38-4e02-83fc-85d44605d5ab service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-32592ea8-d95c-4230-bbaf-23bab3d70822 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-9d9f8431-f08d-47e5-b790-28178ef0e297 req-3ee35810-3326-4bfb-9e42-970cd9fadded service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9d9f8431-f08d-47e5-b790-28178ef0e297 req-3ee35810-3326-4bfb-9e42-970cd9fadded service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9d9f8431-f08d-47e5-b790-28178ef0e297 req-3ee35810-3326-4bfb-9e42-970cd9fadded service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9d9f8431-f08d-47e5-b790-28178ef0e297 req-3ee35810-3326-4bfb-9e42-970cd9fadded service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-9d9f8431-f08d-47e5-b790-28178ef0e297 req-3ee35810-3326-4bfb-9e42-970cd9fadded service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-unplugged-059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-9d9f8431-f08d-47e5-b790-28178ef0e297 req-3ee35810-3326-4bfb-9e42-970cd9fadded service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-059ab46b-9eff-4581-b29d-9858760a64dc for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XfCSecdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:33:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:33:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:33:41 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e282472f-2cea-4c0f-ab95-2560d739c393]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:33:41 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[984f90a1-dd71-4c83-b073-1fc11881748c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b] added
Aug 16 10:33:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9c4ed9-1d0c-425d-9f55-53449684d363]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9656b036-77c6-47a4-8164-f35f09949b8b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XfCSecdj {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XfCSecdj" returned: 0 in 0.032s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8458ff0-b428-4169-8353-bc40100efbc6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XfCSecdj'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bbf6d9-1103-44c0-b03f-4fa5ca2476db]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c069338-cb5a-44e1-9432-a1d7f5a0655d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:41 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:33:41 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:41 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:41 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:33:41 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:41 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --login" returned: 0 in 0.169s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b246973f-52ae-4510-99ad-26b5e234b829]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b, portal: 172.16.0.220,3260]
Aug 16 10:33:41 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b, portal: 172.16.0.220,3260] successful.
Aug 16 10:33:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dd967d-a52e-4cb0-807e-361658945542]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[313460e5-7626-4c9f-b338-f53ac1db6e54]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:42 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:33:42 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:33:42 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:42 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:42 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:33:42 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:33:42 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:42 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Instance destroyed successfully.
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.objects.instance [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lazy-loading 'resources' on Instance uuid 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0859129e-29ed-4a88-91d5-4641666b409d]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "address": "fa:16:3e:53:de:eb", "network": {"id": "092e531c-7d7e-4849-a96b-ba6a51e3ab21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1021692082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008c71c2-37", "ovs_interfaceid": "008c71c2-37af-4e5c-bc2a-bdf5d684595f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:de:eb,bridge_name='br-int',has_traffic_filtering=True,id=008c71c2-37af-4e5c-bc2a-bdf5d684595f,network=Network(092e531c-7d7e-4849-a96b-ba6a51e3ab21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008c71c2-37') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:de:eb,bridge_name='br-int',has_traffic_filtering=True,id=008c71c2-37af-4e5c-bc2a-bdf5d684595f,network=Network(092e531c-7d7e-4849-a96b-ba6a51e3ab21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008c71c2-37') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap008c71c2-37, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: INFO os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:de:eb,bridge_name='br-int',has_traffic_filtering=True,id=008c71c2-37af-4e5c-bc2a-bdf5d684595f,network=Network(092e531c-7d7e-4849-a96b-ba6a51e3ab21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008c71c2-37')
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:4d:ef,bridge_name='br-int',has_traffic_filtering=True,id=73e02a1e-4582-4fd2-b9f7-d4f517272dcc,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73e02a1e-45') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:4d:ef,bridge_name='br-int',has_traffic_filtering=True,id=73e02a1e-4582-4fd2-b9f7-d4f517272dcc,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73e02a1e-45') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73e02a1e-45, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: INFO os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:4d:ef,bridge_name='br-int',has_traffic_filtering=True,id=73e02a1e-4582-4fd2-b9f7-d4f517272dcc,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73e02a1e-45')
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:28:de,bridge_name='br-int',has_traffic_filtering=True,id=4aa4e892-0f74-44af-a97a-794f6e9f9708,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4aa4e892-0f') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:28:de,bridge_name='br-int',has_traffic_filtering=True,id=4aa4e892-0f74-44af-a97a-794f6e9f9708,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4aa4e892-0f') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4aa4e892-0f, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: INFO os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:28:de,bridge_name='br-int',has_traffic_filtering=True,id=4aa4e892-0f74-44af-a97a-794f6e9f9708,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4aa4e892-0f')
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=32592ea8-d95c-4230-bbaf-23bab3d70822,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32592ea8-d9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=32592ea8-d95c-4230-bbaf-23bab3d70822,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32592ea8-d9') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32592ea8-d9, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: INFO os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ef:86,bridge_name='br-int',has_traffic_filtering=True,id=32592ea8-d95c-4230-bbaf-23bab3d70822,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32592ea8-d9')
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:14:da,bridge_name='br-int',has_traffic_filtering=True,id=615324f2-1462-496f-a2e2-847c99c595cb,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap615324f2-14') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:14:da,bridge_name='br-int',has_traffic_filtering=True,id=615324f2-1462-496f-a2e2-847c99c595cb,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap615324f2-14') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap615324f2-14, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: INFO os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:14:da,bridge_name='br-int',has_traffic_filtering=True,id=615324f2-1462-496f-a2e2-847c99c595cb,network=Network(98a88a11-a97b-46b7-9bc5-dae58d84da73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap615324f2-14')
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:42,bridge_name='br-int',has_traffic_filtering=True,id=220a6015-5864-45e5-92f0-f0709163db38,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220a6015-58') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:42,bridge_name='br-int',has_traffic_filtering=True,id=220a6015-5864-45e5-92f0-f0709163db38,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220a6015-58') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap220a6015-58, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: INFO os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:42,bridge_name='br-int',has_traffic_filtering=True,id=220a6015-5864-45e5-92f0-f0709163db38,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220a6015-58')
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T10:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-293134366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-293134366',id=10,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7scCcdRby7w/4bOY8HntGBOM+PlQePl5Bi4hEPYIkIPa4MzMYbpsCxP7ZeyQmPDgAbJbNufaUx/XmabpQBeAJy4gHxZDzB65x644WQkyOuGYoW9xDPJQhITucuULMMbA==',key_name='tempest-keypair-789223988',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b257ac73941441bab8961b8ab61d2edf',ramdisk_id='',reservation_id='r-0uypuzdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1241779598',owner_user_name='tempest-TaggedBootDevicesTest_v242-1241779598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd4efb42518f456d882729f5876b0c85',uuid=11f1d48e-6575-46e8-87a7-ab9defb8a7d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converting VIF {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=059ab46b-9eff-4581-b29d-9858760a64dc,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ab46b-9e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=059ab46b-9eff-4581-b29d-9858760a64dc,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ab46b-9e') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap059ab46b-9e, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:42 user nova-compute[73067]: INFO os_vif [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=059ab46b-9eff-4581-b29d-9858760a64dc,network=Network(ee03fbae-e3dc-4193-847b-0a9e0b9df6a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ab46b-9e')
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLedAaUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:33:42 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:33:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:42 user nova-compute[73067]: WARNING nova.compute.manager [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-32592ea8-d95c-4230-bbaf-23bab3d70822 for instance with vm_state active and task_state deleting.
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-unplugged-615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-615324f2-1462-496f-a2e2-847c99c595cb for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:42 user nova-compute[73067]: WARNING nova.compute.manager [req-ea9f4384-f7e7-47f3-a1dc-396326a1ec9d req-a2421d7e-0974-4099-8dc7-716ef3a43c25 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-615324f2-1462-496f-a2e2-847c99c595cb for instance with vm_state active and task_state deleting.
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XfCSecdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.540s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] <== connect_volume: return (1542ms) {'type': 'block', 'scsi_wwn': '23135626362656438', 'path': '/dev/sdf'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135626362656438', 'path': '/dev/sdf'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.619s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'flavor' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2adfc78-292f-4770-97d0-47d770911f60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:33:43 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:33:43 user nova-compute[73067]:   <source dev="/dev/sdf"/>
Aug 16 10:33:43 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:33:43 user nova-compute[73067]:   <serial>8b6534b8-33c4-4781-9a17-ead5b83f893b</serial>
Aug 16 10:33:43 user nova-compute[73067]: </disk>
Aug 16 10:33:43 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0915bdba-9fe3-4782-b360-eca736b35e8a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f356436a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[666bef55-086e-4a7b-86eb-1f2444c963a0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb7b52f-3062-40ec-81a4-9ac72379bc9d]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07d714d-404b-4069-afa2-de803a2d31fa]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[447bb004-d6d4-4b16-bec1-efc702d175a2]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eb56f7-47b7-46f4-8c51-8babcb4e588f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-16ee47f1-4b3a-4a96-a22f-0adefc7237f2 req-10bd6a1a-53b6-4ac8-8ea5-d25428207857 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16ee47f1-4b3a-4a96-a22f-0adefc7237f2 req-10bd6a1a-53b6-4ac8-8ea5-d25428207857 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16ee47f1-4b3a-4a96-a22f-0adefc7237f2 req-10bd6a1a-53b6-4ac8-8ea5-d25428207857 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16ee47f1-4b3a-4a96-a22f-0adefc7237f2 req-10bd6a1a-53b6-4ac8-8ea5-d25428207857 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-16ee47f1-4b3a-4a96-a22f-0adefc7237f2 req-10bd6a1a-53b6-4ac8-8ea5-d25428207857 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:43 user nova-compute[73067]: WARNING nova.compute.manager [req-16ee47f1-4b3a-4a96-a22f-0adefc7237f2 req-10bd6a1a-53b6-4ac8-8ea5-d25428207857 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-059ab46b-9eff-4581-b29d-9858760a64dc for instance with vm_state active and task_state deleting.
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc2bdc2-ac03-4b84-99db-e879c2dbcbab]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5, portal: 172.16.0.220,3260]
Aug 16 10:33:43 user nova-compute[73067]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5, portal: 172.16.0.220,3260] successful.
Aug 16 10:33:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514d6e94-626c-48d2-9449-7d405704e8c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b316046-0947-485f-a1a6-dec7815745b6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] <== disconnect_volume: return (975ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkIGXmFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:33:43 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb37512-9e9b-4f91-a605-d10eacbb82b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4ffb17-e227-4995-92ed-062cb861388e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba (non-flash)
Aug 16 10:33:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f356436a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba'): ({'sde'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Removing single pathed devices sde {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3ba381-5c11-4cd7-a332-8f4d38569c48]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1334eb96-414a-41c0-a464-e8ab5bb03100]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Flushing IO for device /dev/sde {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] No VIF found with MAC fa:16:3e:46:e1:81, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2867b9ec-369c-4f93-9c2f-ef2660eb0303]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9841c5b-6ebc-4572-91dc-27862ab52b2e]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] SCSI volumes sde have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d0e6f5-a2dc-4305-9e36-087be5372163]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4fcad388-09db-4eff-9732-3014ed3a831e tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.999s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[284c4737-e0d9-46fa-a8fe-2e2e65c7640b]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba, portal: 172.16.0.220,3260]
Aug 16 10:33:43 user nova-compute[73067]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba, portal: 172.16.0.220,3260] successful.
Aug 16 10:33:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0821e48-26bb-4b64-b7b0-67159069c8ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2311ae-4b77-49e3-9236-9e21e419aee3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] <== disconnect_volume: return (386ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qySoxJYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:33:43 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9573d852-89f1-418c-a1ef-35d249995a2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d6c65b-5d03-4121-9f19-cd16e226a635]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:33:43 user nova-compute[73067]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff (non-flash)
Aug 16 10:33:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642cf760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a4dd70-1da6-494e-818c-d3179c0fe271]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06a690e-78bd-4c64-99c1-9bc68c524d21]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f606ea-fd09-4321-ba56-e187e3aefeba]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:33:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1bf35b-fd94-4888-8ca9-2ec5c0d26b7c]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acfb37b-ede5-4882-bf5b-5de033766729]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e8e3b8-3970-4dde-9d41-9769cd30fdca]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff, portal: 172.16.0.220,3260]
Aug 16 10:33:44 user nova-compute[73067]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff, portal: 172.16.0.220,3260] successful.
Aug 16 10:33:44 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba384d4-8b94-40b3-968f-548f9c412cff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdf8be7-509b-43c0-ac6c-e1c4c03b4d4b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] <== disconnect_volume: return (295ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:33:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Deleting instance files /opt/stack/data/nova/instances/11f1d48e-6575-46e8-87a7-ab9defb8a7d7_del
Aug 16 10:33:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Deletion of /opt/stack/data/nova/instances/11f1d48e-6575-46e8-87a7-ab9defb8a7d7_del complete
Aug 16 10:33:44 user nova-compute[73067]: INFO nova.compute.manager [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Took 4.30 seconds to destroy the instance on the hypervisor.
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-54c60254-65f2-4441-b7b1-a871d65c6bc1 req-2744ea1b-0d3f-48aa-9b65-08076d90a183 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-54c60254-65f2-4441-b7b1-a871d65c6bc1 req-2744ea1b-0d3f-48aa-9b65-08076d90a183 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-54c60254-65f2-4441-b7b1-a871d65c6bc1 req-2744ea1b-0d3f-48aa-9b65-08076d90a183 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-54c60254-65f2-4441-b7b1-a871d65c6bc1 req-2744ea1b-0d3f-48aa-9b65-08076d90a183 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-54c60254-65f2-4441-b7b1-a871d65c6bc1 req-2744ea1b-0d3f-48aa-9b65-08076d90a183 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-unplugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-54c60254-65f2-4441-b7b1-a871d65c6bc1 req-2744ea1b-0d3f-48aa-9b65-08076d90a183 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:33:44 user nova-compute[73067]: INFO nova.compute.manager [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Rescuing
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquired lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:33:45 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updating instance_info_cache with network_info: [{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Releasing lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-503d6529-8f3a-4640-9b18-edb99230bfa0 req-a7620e78-8ea0-4e1d-ac14-fcad1452f63a service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-unplugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-503d6529-8f3a-4640-9b18-edb99230bfa0 req-a7620e78-8ea0-4e1d-ac14-fcad1452f63a service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-503d6529-8f3a-4640-9b18-edb99230bfa0 req-a7620e78-8ea0-4e1d-ac14-fcad1452f63a service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-503d6529-8f3a-4640-9b18-edb99230bfa0 req-a7620e78-8ea0-4e1d-ac14-fcad1452f63a service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-503d6529-8f3a-4640-9b18-edb99230bfa0 req-a7620e78-8ea0-4e1d-ac14-fcad1452f63a service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-unplugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:46 user nova-compute[73067]: WARNING nova.compute.manager [req-503d6529-8f3a-4640-9b18-edb99230bfa0 req-a7620e78-8ea0-4e1d-ac14-fcad1452f63a service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-unplugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state active and task_state rescuing.
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:46 user nova-compute[73067]: WARNING nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-008c71c2-37af-4e5c-bc2a-bdf5d684595f for instance with vm_state active and task_state deleting.
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-unplugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:46 user nova-compute[73067]: WARNING nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-73e02a1e-4582-4fd2-b9f7-d4f517272dcc for instance with vm_state active and task_state deleting.
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-unplugged-220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-unplugged-220a6015-5864-45e5-92f0-f0709163db38 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-plugged-220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Acquiring lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] No waiting events found dispatching network-vif-plugged-220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:46 user nova-compute[73067]: WARNING nova.compute.manager [req-9228d608-e7af-41b4-b749-aa4b50bea807 req-9facc566-7543-419e-8abf-6fc213b2fef7 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received unexpected event network-vif-plugged-220a6015-5864-45e5-92f0-f0709163db38 for instance with vm_state active and task_state deleting.
Aug 16 10:33:46 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Instance destroyed successfully.
Aug 16 10:33:46 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Attempting a stable device rescue
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73067) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Instance directory exists: not creating {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 10:33:46 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Creating image(s)
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "34a6674fef6ad6bd1533937324ea94bbfa56d8d6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "34a6674fef6ad6bd1533937324ea94bbfa56d8d6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6.part --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6.part --force-share --output=json" returned: 0 in 0.265s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG nova.virt.images [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] 76a630f5-7cf1-4b3b-8e43-5c5656ff54bb was qcow2, converting to raw {{(pid=73067) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6.part /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6.converted {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d843ce5-85d5-483d-982d-992372834fb1 req-80963c29-4368-476a-a81c-5d94c831b053 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d843ce5-85d5-483d-982d-992372834fb1 req-80963c29-4368-476a-a81c-5d94c831b053 service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d843ce5-85d5-483d-982d-992372834fb1 req-80963c29-4368-476a-a81c-5d94c831b053 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d843ce5-85d5-483d-982d-992372834fb1 req-80963c29-4368-476a-a81c-5d94c831b053 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d843ce5-85d5-483d-982d-992372834fb1 req-80963c29-4368-476a-a81c-5d94c831b053 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:48 user nova-compute[73067]: WARNING nova.compute.manager [req-8d843ce5-85d5-483d-982d-992372834fb1 req-80963c29-4368-476a-a81c-5d94c831b053 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state active and task_state rescuing.
Aug 16 10:33:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6.part /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6.converted" returned: 0 in 0.591s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6.converted --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "34a6674fef6ad6bd1533937324ea94bbfa56d8d6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.186s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "34a6674fef6ad6bd1533937324ea94bbfa56d8d6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "34a6674fef6ad6bd1533937324ea94bbfa56d8d6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6 --force-share --output=json" returned: 0 in 0.229s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6,backing_fmt=raw /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6,backing_fmt=raw /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue" returned: 0 in 0.060s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "34a6674fef6ad6bd1533937324ea94bbfa56d8d6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'migration_context' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Start _get_guest_xml network_info=[{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "vif_mac": "fa:16:3e:46:e1:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '76a630f5-7cf1-4b3b-8e43-5c5656ff54bb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XfCSecdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '6956e66e-229d-4f95-9d0b-d1e8c89a5360', 'attached_at': '', 'detached_at': '', 'volume_id': '8b6534b8-33c4-4781-9a17-ead5b83f893b', 'serial': '8b6534b8-33c4-4781-9a17-ead5b83f893b'}, 'delete_on_termination': False, 'attachment_id': 'e7c7c47f-d86b-4f77-bf8f-fcdd2f11cafb', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'resources' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'numa_topology' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:49 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:33:49 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XfCSecdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:33:49 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:33:49 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:33:49 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e391ea81-3e43-4981-88b2-e2386fd0dbc0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XfCSecdj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 10:33:49 user nova-compute[73067]: node.name = iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b
Aug 16 10:33:49 user nova-compute[73067]: node.tpgt = -1
Aug 16 10:33:49 user nova-compute[73067]: node.startup = automatic
Aug 16 10:33:49 user nova-compute[73067]: node.leading_login = No
Aug 16 10:33:49 user nova-compute[73067]: iface.iscsi_ifacename = default
Aug 16 10:33:49 user nova-compute[73067]: iface.net_ifacename = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.ipaddress = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.prefix_len = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.hwaddress = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.transport_name = tcp
Aug 16 10:33:49 user nova-compute[73067]: iface.initiatorname = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.state = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.vlan_id = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.vlan_priority = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.vlan_state = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.iface_num = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.mtu = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.port = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.bootproto = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.subnet_mask = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.gateway = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.dhcp_alt_client_id = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.dhcp_dns = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.dhcp_learn_iqn = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.dhcp_vendor_id_state = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.dhcp_vendor_id = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.dhcp_slp_da = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.fragmentation = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.gratuitous_arp = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.incoming_forwarding = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.tos_state = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.tos = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.ttl = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.delayed_ack = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.tcp_nagle = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.tcp_wsf_state = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.tcp_wsf = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.tcp_timer_scale = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.tcp_timestamp = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.redirect = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.def_task_mgmt_timeout = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.header_digest = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.data_digest = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.immediate_data = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.initial_r2t = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.data_seq_inorder = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.data_pdu_inorder = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.erl = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.max_receive_data_len = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.first_burst_len = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.max_outstanding_r2t = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.max_burst_len = 0
Aug 16 10:33:49 user nova-compute[73067]: iface.chap_auth = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.bidi_chap = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.strict_login_compliance = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.discovery_auth = <empty>
Aug 16 10:33:49 user nova-compute[73067]: iface.discovery_logout = <empty>
Aug 16 10:33:49 user nova-compute[73067]: node.discovery_address = <empty>
Aug 16 10:33:49 user nova-compute[73067]: node.discovery_port = 0
Aug 16 10:33:49 user nova-compute[73067]: node.discovery_type = static
Aug 16 10:33:49 user nova-compute[73067]: node.session.initial_cmdsn = 0
Aug 16 10:33:49 user nova-compute[73067]: node.session.initial_login_retry_max = 8
Aug 16 10:33:49 user nova-compute[73067]: node.session.xmit_thread_priority = -20
Aug 16 10:33:49 user nova-compute[73067]: node.session.cmds_max = 128
Aug 16 10:33:49 user nova-compute[73067]: node.session.queue_depth = 32
Aug 16 10:33:49 user nova-compute[73067]: node.session.nr_sessions = 1
Aug 16 10:33:49 user nova-compute[73067]: node.session.auth.authmethod = CHAP
Aug 16 10:33:49 user nova-compute[73067]: node.session.auth.username = XfCSecdj
Aug 16 10:33:49 user nova-compute[73067]: node.session.auth.password = ***
Aug 16 10:33:49 user nova-compute[73067]: node.session.auth.username_in = <empty>
Aug 16 10:33:49 user nova-compute[73067]: node.session.auth.password_in = <empty>
Aug 16 10:33:49 user nova-compute[73067]: node.session.auth.chap_algs = MD5
Aug 16 10:33:49 user nova-compute[73067]: node.session.timeo.replacement_timeout = 120
Aug 16 10:33:49 user nova-compute[73067]: node.session.err_timeo.abort_timeout = 15
Aug 16 10:33:49 user nova-compute[73067]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 10:33:49 user nova-compute[73067]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 10:33:49 user nova-compute[73067]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 10:33:49 user nova-compute[73067]: node.session.iscsi.FastAbort = Yes
Aug 16 10:33:49 user nova-compute[73067]: node.session.iscsi.InitialR2T = No
Aug 16 10:33:49 user nova-compute[73067]: node.session.iscsi.ImmediateData = Yes
Aug 16 10:33:49 user nova-compute[73067]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 10:33:49 user nova-compute[73067]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 10:33:49 user nova-compute[73067]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 10:33:49 user nova-compute[73067]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 10:33:49 user nova-compute[73067]: node.session.iscsi.MaxConnections = 1
Aug 16 10:33:49 user nova-compute[73067]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 10:33:49 user nova-compute[73067]: node.session.iscsi.ERL = 0
Aug 16 10:33:49 user nova-compute[73067]: node.session.scan = manual
Aug 16 10:33:49 user nova-compute[73067]: node.session.reopen_max = 0
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].address = 172.16.0.220
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].port = 3260
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].startup = manual
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].tcp.window_size = 524288
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].tcp.type_of_service = 0
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].timeo.logout_timeout = 15
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].timeo.login_timeout = 15
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].timeo.auth_timeout = 45
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].iscsi.DataDigest = None
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].iscsi.IFMarker = No
Aug 16 10:33:49 user nova-compute[73067]: node.conn[0].iscsi.OFMarker = No
Aug 16 10:33:49 user nova-compute[73067]: # END RECORD
Aug 16 10:33:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cedbe4a-3ba9-47db-9cb2-03d3479b5e54]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f09f1d-c448-4b6c-b231-ea528e509408]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XfCSecdj {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XfCSecdj" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee83ba43-8396-4b5b-be22-4e54252ae6ca]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XfCSecdj'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf173d9d-f92b-409e-bb4e-3d11c1478ce3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfea5646-de16-4cff-b032-122770be12b6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:49 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:33:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:33:49 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:33:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.185s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] HCTL ('37', '0', '0', 0) found on session 14 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c1a947-c47f-489d-b1ab-1d18a256986b]: (4, ('0 0 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Searching for a device in session 14 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XfCSecdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.216s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] <== connect_volume: return (217ms) {'type': 'block', 'scsi_wwn': '23135626362656438', 'path': '/dev/sdf'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135626362656438', 'path': '/dev/sdf'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-93500555',display_name='tempest-ServerStableDeviceRescueTest-server-93500555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-93500555',id=4,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnCGChHF3jYXGv2a0SHt5NHUCA92tAWiyv6m86NOx27TMrH8SPc4MLN1jNe9CWzd+kqNF+W4jHQLPaqZl0HDJ27dCKHPSMKrqtlGkbEQO6HvoCiRyAhtMQHATGwVjhGYw==',key_name='tempest-keypair-504698564',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9a85655eedd4d9c9aeb5320fa880c5b',ramdisk_id='',reservation_id='r-gdsl9tze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1826914324',owner_user_name='tempest-ServerStableDeviceRescueTest-1826914324-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:31:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bcfa5c264949eaa13c3f7620340b3c',uuid=6956e66e-229d-4f95-9d0b-d1e8c89a5360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "vif_mac": "fa:16:3e:46:e1:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Converting VIF {"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "vif_mac": "fa:16:3e:46:e1:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=c50ee3f9-3e3b-4896-a303-bdbf8153b3a1,network=Network(9466980a-cc9b-4b41-b2dc-836642bfa8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50ee3f9-3e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'pci_devices' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:33:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:33:49 user nova-compute[73067]:   <uuid>6956e66e-229d-4f95-9d0b-d1e8c89a5360</uuid>
Aug 16 10:33:49 user nova-compute[73067]:   <name>instance-00000004</name>
Aug 16 10:33:49 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:33:49 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:33:49 user nova-compute[73067]:   <metadata>
Aug 16 10:33:49 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:33:49 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:33:49 user nova-compute[73067]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-93500555</nova:name>
Aug 16 10:33:49 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:33:49</nova:creationTime>
Aug 16 10:33:49 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:33:49 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:33:49 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:33:49 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:33:49 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:33:49 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:33:49 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:33:49 user nova-compute[73067]:       <nova:owner>
Aug 16 10:33:49 user nova-compute[73067]:         <nova:user uuid="70bcfa5c264949eaa13c3f7620340b3c">tempest-ServerStableDeviceRescueTest-1826914324-project-member</nova:user>
Aug 16 10:33:49 user nova-compute[73067]:         <nova:project uuid="d9a85655eedd4d9c9aeb5320fa880c5b">tempest-ServerStableDeviceRescueTest-1826914324</nova:project>
Aug 16 10:33:49 user nova-compute[73067]:       </nova:owner>
Aug 16 10:33:49 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:33:49 user nova-compute[73067]:       <nova:ports>
Aug 16 10:33:49 user nova-compute[73067]:         <nova:port uuid="c50ee3f9-3e3b-4896-a303-bdbf8153b3a1">
Aug 16 10:33:49 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 10:33:49 user nova-compute[73067]:         </nova:port>
Aug 16 10:33:49 user nova-compute[73067]:       </nova:ports>
Aug 16 10:33:49 user nova-compute[73067]:     </nova:instance>
Aug 16 10:33:49 user nova-compute[73067]:   </metadata>
Aug 16 10:33:49 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:33:49 user nova-compute[73067]:     <system>
Aug 16 10:33:49 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:33:49 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:33:49 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:33:49 user nova-compute[73067]:       <entry name="serial">6956e66e-229d-4f95-9d0b-d1e8c89a5360</entry>
Aug 16 10:33:49 user nova-compute[73067]:       <entry name="uuid">6956e66e-229d-4f95-9d0b-d1e8c89a5360</entry>
Aug 16 10:33:49 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:33:49 user nova-compute[73067]:     </system>
Aug 16 10:33:49 user nova-compute[73067]:   </sysinfo>
Aug 16 10:33:49 user nova-compute[73067]:   <os>
Aug 16 10:33:49 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:33:49 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:33:49 user nova-compute[73067]:   </os>
Aug 16 10:33:49 user nova-compute[73067]:   <features>
Aug 16 10:33:49 user nova-compute[73067]:     <acpi/>
Aug 16 10:33:49 user nova-compute[73067]:     <apic/>
Aug 16 10:33:49 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:33:49 user nova-compute[73067]:   </features>
Aug 16 10:33:49 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:33:49 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:33:49 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:33:49 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:33:49 user nova-compute[73067]:   </clock>
Aug 16 10:33:49 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:33:49 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:33:49 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:33:49 user nova-compute[73067]:   </cpu>
Aug 16 10:33:49 user nova-compute[73067]:   <devices>
Aug 16 10:33:49 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:33:49 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:33:49 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk"/>
Aug 16 10:33:49 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:33:49 user nova-compute[73067]:     </disk>
Aug 16 10:33:49 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:33:49 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:33:49 user nova-compute[73067]:       <source dev="/dev/sdf"/>
Aug 16 10:33:49 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:33:49 user nova-compute[73067]:       <serial>8b6534b8-33c4-4781-9a17-ead5b83f893b</serial>
Aug 16 10:33:49 user nova-compute[73067]:     </disk>
Aug 16 10:33:49 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:33:49 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:33:49 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue"/>
Aug 16 10:33:49 user nova-compute[73067]:       <target dev="vdc" bus="virtio"/>
Aug 16 10:33:49 user nova-compute[73067]:       <boot order="1"/>
Aug 16 10:33:49 user nova-compute[73067]:     </disk>
Aug 16 10:33:49 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:33:49 user nova-compute[73067]:       <mac address="fa:16:3e:46:e1:81"/>
Aug 16 10:33:49 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:33:49 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:33:49 user nova-compute[73067]:       <target dev="tapc50ee3f9-3e"/>
Aug 16 10:33:49 user nova-compute[73067]:     </interface>
Aug 16 10:33:49 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:33:49 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/console.log" append="off"/>
Aug 16 10:33:49 user nova-compute[73067]:     </serial>
Aug 16 10:33:49 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:33:49 user nova-compute[73067]:     <video>
Aug 16 10:33:49 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:33:49 user nova-compute[73067]:     </video>
Aug 16 10:33:49 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:33:49 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:33:49 user nova-compute[73067]:     </rng>
Aug 16 10:33:49 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:33:49 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:33:49 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:33:49 user nova-compute[73067]:     </memballoon>
Aug 16 10:33:49 user nova-compute[73067]:   </devices>
Aug 16 10:33:49 user nova-compute[73067]: </domain>
Aug 16 10:33:49 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:33:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Instance destroyed successfully.
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] No VIF found with MAC fa:16:3e:46:e1:81, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-deleted-008c71c2-37af-4e5c-bc2a-bdf5d684595f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:50 user nova-compute[73067]: INFO nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Neutron deleted interface 008c71c2-37af-4e5c-bc2a-bdf5d684595f; detaching it from the instance and deleting it from the info cache
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.network.neutron [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [{"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32592ea8-d95c-4230-bbaf-23bab3d70822", "address": "fa:16:3e:fd:ef:86", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32592ea8-d9", "ovs_interfaceid": "32592ea8-d95c-4230-bbaf-23bab3d70822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Detach interface failed, port_id=008c71c2-37af-4e5c-bc2a-bdf5d684595f, reason: Instance 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-deleted-32592ea8-d95c-4230-bbaf-23bab3d70822 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:50 user nova-compute[73067]: INFO nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Neutron deleted interface 32592ea8-d95c-4230-bbaf-23bab3d70822; detaching it from the instance and deleting it from the info cache
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.network.neutron [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [{"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "615324f2-1462-496f-a2e2-847c99c595cb", "address": "fa:16:3e:80:14:da", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap615324f2-14", "ovs_interfaceid": "615324f2-1462-496f-a2e2-847c99c595cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Detach interface failed, port_id=32592ea8-d95c-4230-bbaf-23bab3d70822, reason: Instance 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-deleted-615324f2-1462-496f-a2e2-847c99c595cb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:50 user nova-compute[73067]: INFO nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Neutron deleted interface 615324f2-1462-496f-a2e2-847c99c595cb; detaching it from the instance and deleting it from the info cache
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.network.neutron [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [{"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "059ab46b-9eff-4581-b29d-9858760a64dc", "address": "fa:16:3e:a8:2a:61", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ab46b-9e", "ovs_interfaceid": "059ab46b-9eff-4581-b29d-9858760a64dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Detach interface failed, port_id=615324f2-1462-496f-a2e2-847c99c595cb, reason: Instance 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-deleted-059ab46b-9eff-4581-b29d-9858760a64dc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:50 user nova-compute[73067]: INFO nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Neutron deleted interface 059ab46b-9eff-4581-b29d-9858760a64dc; detaching it from the instance and deleting it from the info cache
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.network.neutron [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [{"id": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "address": "fa:16:3e:da:4d:ef", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e02a1e-45", "ovs_interfaceid": "73e02a1e-4582-4fd2-b9f7-d4f517272dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "address": "fa:16:3e:8c:28:de", "network": {"id": "98a88a11-a97b-46b7-9bc5-dae58d84da73", "bridge": "br-int", "label": "tempest-device-tagging-net1-1135073568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa4e892-0f", "ovs_interfaceid": "4aa4e892-0f74-44af-a97a-794f6e9f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "220a6015-5864-45e5-92f0-f0709163db38", "address": "fa:16:3e:5d:e4:42", "network": {"id": "ee03fbae-e3dc-4193-847b-0a9e0b9df6a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-953720526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b257ac73941441bab8961b8ab61d2edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220a6015-58", "ovs_interfaceid": "220a6015-5864-45e5-92f0-f0709163db38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-f0b54367-f92b-4967-90f6-c7b81ebe8733 req-ee79eef7-3b04-47a4-98be-caa29e251a07 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Detach interface failed, port_id=059ab46b-9eff-4581-b29d-9858760a64dc, reason: Instance 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:33:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:51 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:51 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Took 7.05 seconds to deallocate network for instance.
Aug 16 10:33:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Received event network-vif-deleted-220a6015-5864-45e5-92f0-f0709163db38 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:52 user nova-compute[73067]: WARNING nova.compute.manager [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state active and task_state rescuing.
Aug 16 10:33:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:33:52 user nova-compute[73067]: WARNING nova.compute.manager [req-bd1bef5a-5d47-403d-be3c-7f51df8e03ed req-66d3dc2c-db5f-45f8-938c-a175f63620e3 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state active and task_state rescuing.
Aug 16 10:33:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:33:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:33:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:33:53 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:33:53 user nova-compute[73067]: INFO nova.compute.claims [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Claim successful on node user
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.network.neutron [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:33:54 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for 6956e66e-229d-4f95-9d0b-d1e8c89a5360 due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182034.3684278, 6956e66e-229d-4f95-9d0b-d1e8c89a5360 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] VM Resumed (Lifecycle Event)
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f08113fc-d0aa-4453-af8a-f4d3c7b95da8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:33:54 user nova-compute[73067]: INFO nova.virt.block_device [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Booting with volume 999ca751-8c68-4f24-b23a-8b5d0dca292b at /dev/vda
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.policy [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a82f0b5e6de4d459a9f474ca9eef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3b5056f7f40b79a779c06def8f966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:33:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182034.372466, 6956e66e-229d-4f95-9d0b-d1e8c89a5360 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] VM Started (Lifecycle Event)
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG os_brick.utils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ec1dd5-7ed3-4d93-a2b6-41282d17fec6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2c78ed-1ce5-4ed4-afe6-1cabc6a2459b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[520a72ec-5ca0-4c86-8a51-0429c4f23e6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58665f1-bbae-400d-b65e-88cf0f6d3e16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:33:54 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:33:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc87177c-9234-4684-81c6-5a97345a2859]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG os_brick.utils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:33:54 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Updating existing volume attachment record: 854be245-e017-4e86-9ef7-b45ec7c21ff9 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:33:55 user nova-compute[73067]: DEBUG nova.network.neutron [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Successfully created port: 2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:33:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Successfully updated port: 2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "refresh_cache-6a791852-6268-4679-8b8f-e86eac3d5ad4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquired lock "refresh_cache-6a791852-6268-4679-8b8f-e86eac3d5ad4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-332dc68a-f5f3-4359-86bd-960156aac6cf req-d12f38ef-88c2-4e53-bf9c-8a04aaf0cb25 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-changed-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-332dc68a-f5f3-4359-86bd-960156aac6cf req-d12f38ef-88c2-4e53-bf9c-8a04aaf0cb25 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Refreshing instance network info cache due to event network-changed-2a42b863-50bb-4a5e-acbe-69b57ef321d0. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-332dc68a-f5f3-4359-86bd-960156aac6cf req-d12f38ef-88c2-4e53-bf9c-8a04aaf0cb25 service nova] Acquiring lock "refresh_cache-6a791852-6268-4679-8b8f-e86eac3d5ad4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Updating instance_info_cache with network_info: [{"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Releasing lock "refresh_cache-6a791852-6268-4679-8b8f-e86eac3d5ad4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Instance network_info: |[{"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-332dc68a-f5f3-4359-86bd-960156aac6cf req-d12f38ef-88c2-4e53-bf9c-8a04aaf0cb25 service nova] Acquired lock "refresh_cache-6a791852-6268-4679-8b8f-e86eac3d5ad4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:33:56 user nova-compute[73067]: DEBUG nova.network.neutron [req-332dc68a-f5f3-4359-86bd-960156aac6cf req-d12f38ef-88c2-4e53-bf9c-8a04aaf0cb25 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Refreshing network info cache for port 2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:33:57 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182022.040866, 11f1d48e-6575-46e8-87a7-ab9defb8a7d7 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:33:57 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] VM Stopped (Lifecycle Event)
Aug 16 10:33:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d4a1f86b-1ace-418e-91a2-1648c2f0903d None None] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:33:57 user nova-compute[73067]: DEBUG nova.network.neutron [req-332dc68a-f5f3-4359-86bd-960156aac6cf req-d12f38ef-88c2-4e53-bf9c-8a04aaf0cb25 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Updated VIF entry in instance network info cache for port 2a42b863-50bb-4a5e-acbe-69b57ef321d0. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:33:57 user nova-compute[73067]: DEBUG nova.network.neutron [req-332dc68a-f5f3-4359-86bd-960156aac6cf req-d12f38ef-88c2-4e53-bf9c-8a04aaf0cb25 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Updating instance_info_cache with network_info: [{"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:33:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-332dc68a-f5f3-4359-86bd-960156aac6cf req-d12f38ef-88c2-4e53-bf9c-8a04aaf0cb25 service nova] Releasing lock "refresh_cache-6a791852-6268-4679-8b8f-e86eac3d5ad4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:33:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:00 user nova-compute[73067]: INFO nova.compute.manager [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] [instance: 11f1d48e-6575-46e8-87a7-ab9defb8a7d7] Took 8.76 seconds to detach 3 volumes for instance.
Aug 16 10:34:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:00 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:34:00 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:34:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:00 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Deleted allocations for instance 11f1d48e-6575-46e8-87a7-ab9defb8a7d7
Aug 16 10:34:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8d868a9-7fde-4df4-a6fe-37b9e07d16cf tempest-TaggedBootDevicesTest_v242-1241779598 tempest-TaggedBootDevicesTest_v242-1241779598-project-member] Lock "11f1d48e-6575-46e8-87a7-ab9defb8a7d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.817s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:07 user nova-compute[73067]: INFO nova.compute.manager [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Detaching volume 91da7944-7fb3-409f-be3d-615f989058d3
Aug 16 10:34:07 user nova-compute[73067]: INFO nova.virt.block_device [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Attempting to driver detach volume 91da7944-7fb3-409f-be3d-615f989058d3 from mountpoint /dev/vdb
Aug 16 10:34:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Attempting to detach device vdb from instance b8758033-0b89-4953-b96b-0dc227bb3a3d from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:34:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:34:07 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:34:07 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 10:34:07 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:34:07 user nova-compute[73067]:   <serial>91da7944-7fb3-409f-be3d-615f989058d3</serial>
Aug 16 10:34:07 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:34:07 user nova-compute[73067]: </disk>
Aug 16 10:34:07 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:34:07 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Successfully detached device vdb from instance b8758033-0b89-4953-b96b-0dc227bb3a3d from the persistent domain config.
Aug 16 10:34:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8758033-0b89-4953-b96b-0dc227bb3a3d from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:34:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:34:07 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:34:07 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 10:34:07 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:34:07 user nova-compute[73067]:   <serial>91da7944-7fb3-409f-be3d-615f989058d3</serial>
Aug 16 10:34:07 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:34:07 user nova-compute[73067]: </disk>
Aug 16 10:34:07 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:34:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182048.0199177, b8758033-0b89-4953-b96b-0dc227bb3a3d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8758033-0b89-4953-b96b-0dc227bb3a3d {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:34:08 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Successfully detached device vdb from instance b8758033-0b89-4953-b96b-0dc227bb3a3d from the live domain config.
Aug 16 10:34:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBVIGDSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:34:08 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cb9368-1beb-4e3a-b461-7576091ccc95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb18e6a-3948-4d3e-8663-0e9f1aa8c1e8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:34:08 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:34:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 (non-flash)
Aug 16 10:34:08 user nova-compute[73067]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:34:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642c4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3'): ({'sdd'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Removing single pathed devices sdd {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b31f4-3e92-4b49-b2da-74f9bd23ad2b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b26c550-123f-4135-8eda-242689aebfd1]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Flushing IO for device /dev/sdd {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[be19cca1-db08-4737-917a-d211c1822246]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda68d1-14a3-4621-8213-1f8c8d42af73]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f076da-a8ee-422a-abf6-d81a802f39c7]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46caae0-8026-4887-a0cc-cbfb5c200cd8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3, portal: 172.16.0.220,3260]
Aug 16 10:34:08 user nova-compute[73067]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3, portal: 172.16.0.220,3260] successful.
Aug 16 10:34:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4308dfe1-dc02-469b-81b6-230dc2949a6f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] <== disconnect_volume: return (326ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:34:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG nova.objects.instance [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'flavor' on Instance uuid b8758033-0b89-4953-b96b-0dc227bb3a3d {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-334bf718-9000-4269-b004-1a0e8d941820 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.963s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.742s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:09 user nova-compute[73067]: INFO nova.compute.manager [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Terminating instance
Aug 16 10:34:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-88fab0da-2d40-482c-8436-dd0593898c85 req-b01f4e4a-80d0-4ad8-a15d-2801eb9574bb service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received event network-vif-unplugged-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-88fab0da-2d40-482c-8436-dd0593898c85 req-b01f4e4a-80d0-4ad8-a15d-2801eb9574bb service nova] Acquiring lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-88fab0da-2d40-482c-8436-dd0593898c85 req-b01f4e4a-80d0-4ad8-a15d-2801eb9574bb service nova] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-88fab0da-2d40-482c-8436-dd0593898c85 req-b01f4e4a-80d0-4ad8-a15d-2801eb9574bb service nova] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-88fab0da-2d40-482c-8436-dd0593898c85 req-b01f4e4a-80d0-4ad8-a15d-2801eb9574bb service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] No waiting events found dispatching network-vif-unplugged-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:34:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-88fab0da-2d40-482c-8436-dd0593898c85 req-b01f4e4a-80d0-4ad8-a15d-2801eb9574bb service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received event network-vif-unplugged-911406a5-d202-4d4a-88e0-237a6168701b for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:34:10 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Instance destroyed successfully.
Aug 16 10:34:10 user nova-compute[73067]: DEBUG nova.objects.instance [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'resources' on Instance uuid b8758033-0b89-4953-b96b-0dc227bb3a3d {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1663048354',display_name='tempest-VolumesSnapshotTestJSON-instance-1663048354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1663048354',id=12,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2mGK4KFS7l5nWcGBSUytiUP4Bk5Ll2gffv2s0kvwO9yJK4ljI7RS8S3y6rr2Omr6vGFVXMVTtap/WGTNmClXgVfXuWbufHTSfXI1WJQ7IdYsOZyI9R+aL+cPRNkaVdvQ==',key_name='tempest-keypair-817635519',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:31:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1171c517852847f5a1de1e6236fa753e',ramdisk_id='',reservation_id='r-df6fkisd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-78639816',owner_user_name='tempest-VolumesSnapshotTestJSON-78639816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:31:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcce750fe55c44809a3c42265e64f54c',uuid=b8758033-0b89-4953-b96b-0dc227bb3a3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converting VIF {"id": "911406a5-d202-4d4a-88e0-237a6168701b", "address": "fa:16:3e:a3:de:c6", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911406a5-d2", "ovs_interfaceid": "911406a5-d202-4d4a-88e0-237a6168701b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:de:c6,bridge_name='br-int',has_traffic_filtering=True,id=911406a5-d202-4d4a-88e0-237a6168701b,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911406a5-d2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_vif [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:de:c6,bridge_name='br-int',has_traffic_filtering=True,id=911406a5-d202-4d4a-88e0-237a6168701b,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911406a5-d2') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap911406a5-d2, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:34:10 user nova-compute[73067]: INFO os_vif [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:de:c6,bridge_name='br-int',has_traffic_filtering=True,id=911406a5-d202-4d4a-88e0-237a6168701b,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911406a5-d2')
Aug 16 10:34:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBVIGDSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:34:10 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91da7944-7fb3-409f-be3d-615f989058d3', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c527a7b-06b6-4c99-87f5-d1a3a4a2f9c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b5f77-0f6f-47d6-9193-5631205588b9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:34:10 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:34:10 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642db880>, {}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Disconnecting from: [] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] <== disconnect_volume: return (52ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:34:10 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Deleting instance files /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d_del
Aug 16 10:34:10 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Deletion of /opt/stack/data/nova/instances/b8758033-0b89-4953-b96b-0dc227bb3a3d_del complete
Aug 16 10:34:10 user nova-compute[73067]: INFO nova.compute.manager [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 16 10:34:10 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:34:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-4b47c5d9-0b26-4de4-a61e-f1c2de002e12 req-3001a26c-3f65-458a-83ae-3964fa18e175 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received event network-vif-plugged-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4b47c5d9-0b26-4de4-a61e-f1c2de002e12 req-3001a26c-3f65-458a-83ae-3964fa18e175 service nova] Acquiring lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4b47c5d9-0b26-4de4-a61e-f1c2de002e12 req-3001a26c-3f65-458a-83ae-3964fa18e175 service nova] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4b47c5d9-0b26-4de4-a61e-f1c2de002e12 req-3001a26c-3f65-458a-83ae-3964fa18e175 service nova] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-4b47c5d9-0b26-4de4-a61e-f1c2de002e12 req-3001a26c-3f65-458a-83ae-3964fa18e175 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] No waiting events found dispatching network-vif-plugged-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:34:11 user nova-compute[73067]: WARNING nova.compute.manager [req-4b47c5d9-0b26-4de4-a61e-f1c2de002e12 req-3001a26c-3f65-458a-83ae-3964fa18e175 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received unexpected event network-vif-plugged-911406a5-d202-4d4a-88e0-237a6168701b for instance with vm_state active and task_state deleting.
Aug 16 10:34:11 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:34:11 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Took 1.55 seconds to deallocate network for instance.
Aug 16 10:34:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-98562ea4-55ce-4974-859b-2021a7d2e251 req-a7034611-0bf5-436f-ab08-c18833a4dae4 service nova] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Received event network-vif-deleted-911406a5-d202-4d4a-88e0-237a6168701b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:11 user nova-compute[73067]: WARNING nova.volume.cinder [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Attachment f6316eb3-5629-4e64-b532-571f32d08634 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f6316eb3-5629-4e64-b532-571f32d08634. (HTTP 404) (Request-ID: req-6c9c9d59-5b51-4e1a-865b-56d034f6d8ba)
Aug 16 10:34:11 user nova-compute[73067]: INFO nova.compute.manager [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Took 0.04 seconds to detach 1 volumes for instance.
Aug 16 10:34:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:12 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:34:12 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:34:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.562s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:12 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Deleted allocations for instance b8758033-0b89-4953-b96b-0dc227bb3a3d
Aug 16 10:34:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-85088e7a-be70-46a9-906f-2eb72f4280d1 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "b8758033-0b89-4953-b96b-0dc227bb3a3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.390s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:34:15 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Creating image(s)
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Ensure instance console log exists: /opt/stack/data/nova/instances/6a791852-6268-4679-8b8f-e86eac3d5ad4/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Start _get_guest_xml network_info=[{"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNflELXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a791852-6268-4679-8b8f-e86eac3d5ad4', 'attached_at': '', 'detached_at': '', 'volume_id': '999ca751-8c68-4f24-b23a-8b5d0dca292b', 'serial': '999ca751-8c68-4f24-b23a-8b5d0dca292b'}, 'delete_on_termination': True, 'attachment_id': '854be245-e017-4e86-9ef7-b45ec7c21ff9', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:34:15 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:34:15 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:34:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNflELXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:34:16 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:34:16 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:34:16 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc444061-5956-46b1-ad1f-4cbb6e209e29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:34:16 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c479c4-9ec9-4b45-90e2-e2f6ac03bfa5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b] added
Aug 16 10:34:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[186643c5-10f2-4b4c-aa82-955ea1393759]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6c3d83-cc8b-4ba4-ae74-75ff79ccb9e2]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNflELXc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNflELXc" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcb98cf-5be4-4642-8ce9-5c5eff9ee56d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DNflELXc'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f5721a-6374-4776-bf1d-83c17b07f58c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a785bf-0212-4d93-aaec-96abcc5b14e3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:34:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:34:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be91204-42d5-41ae-96e4-292e27cf73b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260]
Aug 16 10:34:16 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260] successful.
Aug 16 10:34:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6362f30f-5da1-47dd-8709-0b92f1d549fe]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1634638-3d69-4d91-9593-188b7db78172]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:34:16 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:34:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:34:16 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:34:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[95137369-f93c-4118-be75-d18a917bb026]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:34:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNflELXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26465393531346438', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465393531346438', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1270920761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1270920761',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh0HAwQTZopjSQvK4nRNzkmupgLc79gEeAnD6JiXUo09M1Aow2M59+WM4PCI/pkDjFgU58/V8/dsPWTgCy06otTlpj2gcZiXpmpK3PlioaPiBZfU7RdCLMYdPEz4NhR+Q==',key_name='tempest-keypair-263281918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ab3b5056f7f40b79a779c06def8f966',ramdisk_id='',reservation_id='r-eijqx0a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-327151388',owner_user_name='tempest-ServerActionsV293TestJSON-327151388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:33:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a82f0b5e6de4d459a9f474ca9eef0a3',uuid=6a791852-6268-4679-8b8f-e86eac3d5ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converting VIF {"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.objects.instance [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a791852-6268-4679-8b8f-e86eac3d5ad4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:34:17 user nova-compute[73067]:   <uuid>6a791852-6268-4679-8b8f-e86eac3d5ad4</uuid>
Aug 16 10:34:17 user nova-compute[73067]:   <name>instance-00000011</name>
Aug 16 10:34:17 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:34:17 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:34:17 user nova-compute[73067]:   <metadata>
Aug 16 10:34:17 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:34:17 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:34:17 user nova-compute[73067]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1270920761</nova:name>
Aug 16 10:34:17 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:34:15</nova:creationTime>
Aug 16 10:34:17 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:34:17 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:34:17 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:34:17 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:34:17 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:34:17 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:34:17 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:34:17 user nova-compute[73067]:       <nova:owner>
Aug 16 10:34:17 user nova-compute[73067]:         <nova:user uuid="0a82f0b5e6de4d459a9f474ca9eef0a3">tempest-ServerActionsV293TestJSON-327151388-project-member</nova:user>
Aug 16 10:34:17 user nova-compute[73067]:         <nova:project uuid="8ab3b5056f7f40b79a779c06def8f966">tempest-ServerActionsV293TestJSON-327151388</nova:project>
Aug 16 10:34:17 user nova-compute[73067]:       </nova:owner>
Aug 16 10:34:17 user nova-compute[73067]:       <nova:ports>
Aug 16 10:34:17 user nova-compute[73067]:         <nova:port uuid="2a42b863-50bb-4a5e-acbe-69b57ef321d0">
Aug 16 10:34:17 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 10:34:17 user nova-compute[73067]:         </nova:port>
Aug 16 10:34:17 user nova-compute[73067]:       </nova:ports>
Aug 16 10:34:17 user nova-compute[73067]:     </nova:instance>
Aug 16 10:34:17 user nova-compute[73067]:   </metadata>
Aug 16 10:34:17 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:34:17 user nova-compute[73067]:     <system>
Aug 16 10:34:17 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:34:17 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:34:17 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:34:17 user nova-compute[73067]:       <entry name="serial">6a791852-6268-4679-8b8f-e86eac3d5ad4</entry>
Aug 16 10:34:17 user nova-compute[73067]:       <entry name="uuid">6a791852-6268-4679-8b8f-e86eac3d5ad4</entry>
Aug 16 10:34:17 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:34:17 user nova-compute[73067]:     </system>
Aug 16 10:34:17 user nova-compute[73067]:   </sysinfo>
Aug 16 10:34:17 user nova-compute[73067]:   <os>
Aug 16 10:34:17 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:34:17 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:34:17 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:34:17 user nova-compute[73067]:   </os>
Aug 16 10:34:17 user nova-compute[73067]:   <features>
Aug 16 10:34:17 user nova-compute[73067]:     <acpi/>
Aug 16 10:34:17 user nova-compute[73067]:     <apic/>
Aug 16 10:34:17 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:34:17 user nova-compute[73067]:   </features>
Aug 16 10:34:17 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:34:17 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:34:17 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:34:17 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:34:17 user nova-compute[73067]:   </clock>
Aug 16 10:34:17 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:34:17 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:34:17 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:34:17 user nova-compute[73067]:   </cpu>
Aug 16 10:34:17 user nova-compute[73067]:   <devices>
Aug 16 10:34:17 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:34:17 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:34:17 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 10:34:17 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:34:17 user nova-compute[73067]:       <serial>999ca751-8c68-4f24-b23a-8b5d0dca292b</serial>
Aug 16 10:34:17 user nova-compute[73067]:     </disk>
Aug 16 10:34:17 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:34:17 user nova-compute[73067]:       <mac address="fa:16:3e:cc:72:90"/>
Aug 16 10:34:17 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:34:17 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:34:17 user nova-compute[73067]:       <target dev="tap2a42b863-50"/>
Aug 16 10:34:17 user nova-compute[73067]:     </interface>
Aug 16 10:34:17 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:34:17 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/6a791852-6268-4679-8b8f-e86eac3d5ad4/console.log" append="off"/>
Aug 16 10:34:17 user nova-compute[73067]:     </serial>
Aug 16 10:34:17 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:34:17 user nova-compute[73067]:     <video>
Aug 16 10:34:17 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:34:17 user nova-compute[73067]:     </video>
Aug 16 10:34:17 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:34:17 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:34:17 user nova-compute[73067]:     </rng>
Aug 16 10:34:17 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:34:17 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:34:17 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:34:17 user nova-compute[73067]:     </memballoon>
Aug 16 10:34:17 user nova-compute[73067]:   </devices>
Aug 16 10:34:17 user nova-compute[73067]: </domain>
Aug 16 10:34:17 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1270920761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1270920761',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh0HAwQTZopjSQvK4nRNzkmupgLc79gEeAnD6JiXUo09M1Aow2M59+WM4PCI/pkDjFgU58/V8/dsPWTgCy06otTlpj2gcZiXpmpK3PlioaPiBZfU7RdCLMYdPEz4NhR+Q==',key_name='tempest-keypair-263281918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ab3b5056f7f40b79a779c06def8f966',ramdisk_id='',reservation_id='r-eijqx0a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-327151388',owner_user_name='tempest-ServerActionsV293TestJSON-327151388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:33:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a82f0b5e6de4d459a9f474ca9eef0a3',uuid=6a791852-6268-4679-8b8f-e86eac3d5ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converting VIF {"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG os_vif [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a42b863-50, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a42b863-50, col_values=(('external_ids', {'iface-id': '2a42b863-50bb-4a5e-acbe-69b57ef321d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:72:90', 'vm-uuid': '6a791852-6268-4679-8b8f-e86eac3d5ad4'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:17 user nova-compute[73067]: INFO os_vif [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50')
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:34:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] No VIF found with MAC fa:16:3e:cc:72:90, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:34:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-d8eeb07e-4bf3-4814-847c-baf8ae1e4558 req-dcece693-dedc-495d-8d78-1b2e0c65b3bc service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d8eeb07e-4bf3-4814-847c-baf8ae1e4558 req-dcece693-dedc-495d-8d78-1b2e0c65b3bc service nova] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d8eeb07e-4bf3-4814-847c-baf8ae1e4558 req-dcece693-dedc-495d-8d78-1b2e0c65b3bc service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d8eeb07e-4bf3-4814-847c-baf8ae1e4558 req-dcece693-dedc-495d-8d78-1b2e0c65b3bc service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-d8eeb07e-4bf3-4814-847c-baf8ae1e4558 req-dcece693-dedc-495d-8d78-1b2e0c65b3bc service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] No waiting events found dispatching network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:34:19 user nova-compute[73067]: WARNING nova.compute.manager [req-d8eeb07e-4bf3-4814-847c-baf8ae1e4558 req-dcece693-dedc-495d-8d78-1b2e0c65b3bc service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received unexpected event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 for instance with vm_state building and task_state spawning.
Aug 16 10:34:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182061.2465699, 6a791852-6268-4679-8b8f-e86eac3d5ad4 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:34:21 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] VM Resumed (Lifecycle Event)
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:34:21 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Instance spawned successfully.
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:34:21 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182061.2503817, 6a791852-6268-4679-8b8f-e86eac3d5ad4 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:34:21 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] VM Started (Lifecycle Event)
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:34:21 user nova-compute[73067]: INFO nova.compute.manager [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:21 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:34:21 user nova-compute[73067]: INFO nova.compute.manager [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Took 27.73 seconds to build instance.
Aug 16 10:34:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-944ffcfd-1c6b-47a2-bd1b-a694e3ae700c tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.883s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-b33f39ae-12c9-4d00-8838-6d422133d156 req-5af376de-a199-4ecc-8618-1696ba0c7a35 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b33f39ae-12c9-4d00-8838-6d422133d156 req-5af376de-a199-4ecc-8618-1696ba0c7a35 service nova] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b33f39ae-12c9-4d00-8838-6d422133d156 req-5af376de-a199-4ecc-8618-1696ba0c7a35 service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b33f39ae-12c9-4d00-8838-6d422133d156 req-5af376de-a199-4ecc-8618-1696ba0c7a35 service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-b33f39ae-12c9-4d00-8838-6d422133d156 req-5af376de-a199-4ecc-8618-1696ba0c7a35 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] No waiting events found dispatching network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:34:21 user nova-compute[73067]: WARNING nova.compute.manager [req-b33f39ae-12c9-4d00-8838-6d422133d156 req-5af376de-a199-4ecc-8618-1696ba0c7a35 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received unexpected event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 for instance with vm_state active and task_state None.
Aug 16 10:34:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:25 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182050.0658536, b8758033-0b89-4953-b96b-0dc227bb3a3d => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:34:25 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] VM Stopped (Lifecycle Event)
Aug 16 10:34:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7c111a41-67ed-47c4-9595-6fa6a5bf5913 None None] [instance: b8758033-0b89-4953-b96b-0dc227bb3a3d] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:32 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:34:32 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7402MB free_disk=25.49321746826172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b51879a0-d5a1-4f96-b0c1-0672d31e80db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f7014e03-d278-40cf-8a7b-c798d76c87b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 2f25b2a2-25fd-4146-abba-152967481a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ffe1f07d-0a48-431d-be98-7e78018faa10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6a791852-6268-4679-8b8f-e86eac3d5ad4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:34:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:34 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:34:34 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:34:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:34:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:34:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:34:35 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:34:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Updating instance_info_cache with network_info: [{"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:34:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-cca10fa3-1289-4ee9-b1d8-fe37afc92960" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:34:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:34:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:34:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:34:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:34:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:34:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:34:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:34:45 user nova-compute[73067]: INFO nova.compute.claims [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Claim successful on node user
Aug 16 10:34:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:34:46 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:34:46 user nova-compute[73067]: INFO nova.compute.claims [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Claim successful on node user
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:34:46 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Creating image(s)
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "/opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "/opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "/opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG nova.policy [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be44e520761a493aab4b2a5973edd39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ce3a633ff54025aebcee0c30986ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.194s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.169s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk 1073741824" returned: 0 in 0.059s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.235s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:34:47 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Cannot resize image /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'migration_context' on Instance uuid 2448aa3f-a0a6-43c6-8844-dbfb8145d779 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Ensure instance console log exists: /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:34:47 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Creating image(s)
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "/opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "/opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG nova.policy [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b135edcf064595b8d93052903696a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03e64450654fd693d6a1bd43017880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.199s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk 1073741824" returned: 0 in 0.054s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.207s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:34:48 user nova-compute[73067]: INFO nova.compute.claims [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Claim successful on node user
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Cannot resize image /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'migration_context' on Instance uuid a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Ensure instance console log exists: /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.590s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.network.neutron [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:34:48 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:34:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.policy [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c07aeeaa3b248358386475d9cab6197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0867b7c5756147859834ccb143e32e83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:34:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Creating image(s)
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "/opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "/opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.197s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk 1073741824" returned: 0 in 0.069s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Successfully created port: 23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.207s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Successfully created port: 2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Successfully created port: 00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Cannot resize image /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.objects.instance [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'migration_context' on Instance uuid fcb6379a-4c57-462b-a4ea-9680340a5137 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Ensure instance console log exists: /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Successfully updated port: 00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquired lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-7172b4df-1998-46b9-a38b-d3cf87692823 req-3c15523f-b8bf-4c13-b214-fe3d75ce8c00 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received event network-changed-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-7172b4df-1998-46b9-a38b-d3cf87692823 req-3c15523f-b8bf-4c13-b214-fe3d75ce8c00 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Refreshing instance network info cache due to event network-changed-00b9e9ea-45dd-4562-b426-4d1138de93b4. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7172b4df-1998-46b9-a38b-d3cf87692823 req-3c15523f-b8bf-4c13-b214-fe3d75ce8c00 service nova] Acquiring lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updating instance_info_cache with network_info: [{"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Releasing lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Instance network_info: |[{"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7172b4df-1998-46b9-a38b-d3cf87692823 req-3c15523f-b8bf-4c13-b214-fe3d75ce8c00 service nova] Acquired lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-7172b4df-1998-46b9-a38b-d3cf87692823 req-3c15523f-b8bf-4c13-b214-fe3d75ce8c00 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Refreshing network info cache for port 00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Start _get_guest_xml network_info=[{"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:34:51 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:34:51 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1701261229',display_name='tempest-TestStampPattern-server-1701261229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1701261229',id=20,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhzbKl1sw2z92eEIWjGNXUHNDN+YFEF4o3EjSp4os/3KmUko/NUObr7P/Lm/HSenjudyIwF5g3sozv6zWEvvQfItOK8+Iy7HLWvdjDnl1Gv1Fe+d7iktSOtMwmKR6EbRw==',key_name='tempest-TestStampPattern-1751724200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0867b7c5756147859834ccb143e32e83',ramdisk_id='',reservation_id='r-0b2o14b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-920566978',owner_user_name='tempest-TestStampPattern-920566978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:34:49Z,user_data=None,user_id='5c07aeeaa3b248358386475d9cab6197',uuid=fcb6379a-4c57-462b-a4ea-9680340a5137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converting VIF {"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e6:b8,bridge_name='br-int',has_traffic_filtering=True,id=00b9e9ea-45dd-4562-b426-4d1138de93b4,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b9e9ea-45') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.objects.instance [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'pci_devices' on Instance uuid fcb6379a-4c57-462b-a4ea-9680340a5137 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:34:51 user nova-compute[73067]:   <uuid>fcb6379a-4c57-462b-a4ea-9680340a5137</uuid>
Aug 16 10:34:51 user nova-compute[73067]:   <name>instance-00000014</name>
Aug 16 10:34:51 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:34:51 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:34:51 user nova-compute[73067]:   <metadata>
Aug 16 10:34:51 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:34:51 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:34:51 user nova-compute[73067]:       <nova:name>tempest-TestStampPattern-server-1701261229</nova:name>
Aug 16 10:34:51 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:34:51</nova:creationTime>
Aug 16 10:34:51 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:34:51 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:34:51 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:34:51 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:34:51 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:34:51 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:34:51 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:34:51 user nova-compute[73067]:       <nova:owner>
Aug 16 10:34:51 user nova-compute[73067]:         <nova:user uuid="5c07aeeaa3b248358386475d9cab6197">tempest-TestStampPattern-920566978-project-member</nova:user>
Aug 16 10:34:51 user nova-compute[73067]:         <nova:project uuid="0867b7c5756147859834ccb143e32e83">tempest-TestStampPattern-920566978</nova:project>
Aug 16 10:34:51 user nova-compute[73067]:       </nova:owner>
Aug 16 10:34:51 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:34:51 user nova-compute[73067]:       <nova:ports>
Aug 16 10:34:51 user nova-compute[73067]:         <nova:port uuid="00b9e9ea-45dd-4562-b426-4d1138de93b4">
Aug 16 10:34:51 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 10:34:51 user nova-compute[73067]:         </nova:port>
Aug 16 10:34:51 user nova-compute[73067]:       </nova:ports>
Aug 16 10:34:51 user nova-compute[73067]:     </nova:instance>
Aug 16 10:34:51 user nova-compute[73067]:   </metadata>
Aug 16 10:34:51 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:34:51 user nova-compute[73067]:     <system>
Aug 16 10:34:51 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:34:51 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:34:51 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:34:51 user nova-compute[73067]:       <entry name="serial">fcb6379a-4c57-462b-a4ea-9680340a5137</entry>
Aug 16 10:34:51 user nova-compute[73067]:       <entry name="uuid">fcb6379a-4c57-462b-a4ea-9680340a5137</entry>
Aug 16 10:34:51 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:34:51 user nova-compute[73067]:     </system>
Aug 16 10:34:51 user nova-compute[73067]:   </sysinfo>
Aug 16 10:34:51 user nova-compute[73067]:   <os>
Aug 16 10:34:51 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:34:51 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:34:51 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:34:51 user nova-compute[73067]:   </os>
Aug 16 10:34:51 user nova-compute[73067]:   <features>
Aug 16 10:34:51 user nova-compute[73067]:     <acpi/>
Aug 16 10:34:51 user nova-compute[73067]:     <apic/>
Aug 16 10:34:51 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:34:51 user nova-compute[73067]:   </features>
Aug 16 10:34:51 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:34:51 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:34:51 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:34:51 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:34:51 user nova-compute[73067]:   </clock>
Aug 16 10:34:51 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:34:51 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:34:51 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:34:51 user nova-compute[73067]:   </cpu>
Aug 16 10:34:51 user nova-compute[73067]:   <devices>
Aug 16 10:34:51 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:34:51 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:34:51 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk"/>
Aug 16 10:34:51 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:34:51 user nova-compute[73067]:     </disk>
Aug 16 10:34:51 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:34:51 user nova-compute[73067]:       <mac address="fa:16:3e:1c:e6:b8"/>
Aug 16 10:34:51 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:34:51 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:34:51 user nova-compute[73067]:       <target dev="tap00b9e9ea-45"/>
Aug 16 10:34:51 user nova-compute[73067]:     </interface>
Aug 16 10:34:51 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:34:51 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/console.log" append="off"/>
Aug 16 10:34:51 user nova-compute[73067]:     </serial>
Aug 16 10:34:51 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:34:51 user nova-compute[73067]:     <video>
Aug 16 10:34:51 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:34:51 user nova-compute[73067]:     </video>
Aug 16 10:34:51 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:34:51 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:34:51 user nova-compute[73067]:     </rng>
Aug 16 10:34:51 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:34:51 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:34:51 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:34:51 user nova-compute[73067]:     </memballoon>
Aug 16 10:34:51 user nova-compute[73067]:   </devices>
Aug 16 10:34:51 user nova-compute[73067]: </domain>
Aug 16 10:34:51 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1701261229',display_name='tempest-TestStampPattern-server-1701261229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1701261229',id=20,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhzbKl1sw2z92eEIWjGNXUHNDN+YFEF4o3EjSp4os/3KmUko/NUObr7P/Lm/HSenjudyIwF5g3sozv6zWEvvQfItOK8+Iy7HLWvdjDnl1Gv1Fe+d7iktSOtMwmKR6EbRw==',key_name='tempest-TestStampPattern-1751724200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0867b7c5756147859834ccb143e32e83',ramdisk_id='',reservation_id='r-0b2o14b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-920566978',owner_user_name='tempest-TestStampPattern-920566978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:34:49Z,user_data=None,user_id='5c07aeeaa3b248358386475d9cab6197',uuid=fcb6379a-4c57-462b-a4ea-9680340a5137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converting VIF {"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e6:b8,bridge_name='br-int',has_traffic_filtering=True,id=00b9e9ea-45dd-4562-b426-4d1138de93b4,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b9e9ea-45') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG os_vif [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e6:b8,bridge_name='br-int',has_traffic_filtering=True,id=00b9e9ea-45dd-4562-b426-4d1138de93b4,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b9e9ea-45') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00b9e9ea-45, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00b9e9ea-45, col_values=(('external_ids', {'iface-id': '00b9e9ea-45dd-4562-b426-4d1138de93b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:e6:b8', 'vm-uuid': 'fcb6379a-4c57-462b-a4ea-9680340a5137'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:51 user nova-compute[73067]: INFO os_vif [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e6:b8,bridge_name='br-int',has_traffic_filtering=True,id=00b9e9ea-45dd-4562-b426-4d1138de93b4,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b9e9ea-45')
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] No VIF found with MAC fa:16:3e:1c:e6:b8, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Successfully updated port: 23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquired lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-830d24ad-435d-4162-9c44-d2528974633a req-495cf545-a6a6-41b3-aee5-3bac0a702de6 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received event network-changed-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-830d24ad-435d-4162-9c44-d2528974633a req-495cf545-a6a6-41b3-aee5-3bac0a702de6 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Refreshing instance network info cache due to event network-changed-23ba3836-0532-4a97-aa9c-2fdbf6cbef26. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-830d24ad-435d-4162-9c44-d2528974633a req-495cf545-a6a6-41b3-aee5-3bac0a702de6 service nova] Acquiring lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-7172b4df-1998-46b9-a38b-d3cf87692823 req-3c15523f-b8bf-4c13-b214-fe3d75ce8c00 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updated VIF entry in instance network info cache for port 00b9e9ea-45dd-4562-b426-4d1138de93b4. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-7172b4df-1998-46b9-a38b-d3cf87692823 req-3c15523f-b8bf-4c13-b214-fe3d75ce8c00 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updating instance_info_cache with network_info: [{"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7172b4df-1998-46b9-a38b-d3cf87692823 req-3c15523f-b8bf-4c13-b214-fe3d75ce8c00 service nova] Releasing lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:34:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Successfully updated port: 2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquired lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Updating instance_info_cache with network_info: [{"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Releasing lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Instance network_info: |[{"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-830d24ad-435d-4162-9c44-d2528974633a req-495cf545-a6a6-41b3-aee5-3bac0a702de6 service nova] Acquired lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.neutron [req-830d24ad-435d-4162-9c44-d2528974633a req-495cf545-a6a6-41b3-aee5-3bac0a702de6 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Refreshing network info cache for port 23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Start _get_guest_xml network_info=[{"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:34:52 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:34:52 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1884560080',display_name='tempest-AttachVolumeNegativeTest-server-1884560080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1884560080',id=18,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRN+t+EoHP67fhfeMSFGoswweiFsS03ZZwJDwBe7aC5BOqV+MymEmmAqtSDZxJFTsM3PMTtPGDUEf/9PcFo7R54kr9NOczPbdigkMQnXYD1TnEoA7NIm2cTFVUVsoF4gQ==',key_name='tempest-keypair-1298336385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-0pqgplmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=2448aa3f-a0a6-43c6-8844-dbfb8145d779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d4:32,bridge_name='br-int',has_traffic_filtering=True,id=23ba3836-0532-4a97-aa9c-2fdbf6cbef26,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ba3836-05') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'pci_devices' on Instance uuid 2448aa3f-a0a6-43c6-8844-dbfb8145d779 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:34:52 user nova-compute[73067]:   <uuid>2448aa3f-a0a6-43c6-8844-dbfb8145d779</uuid>
Aug 16 10:34:52 user nova-compute[73067]:   <name>instance-00000012</name>
Aug 16 10:34:52 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:34:52 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:34:52 user nova-compute[73067]:   <metadata>
Aug 16 10:34:52 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:34:52 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1884560080</nova:name>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:34:52</nova:creationTime>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:34:52 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:34:52 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:owner>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:user uuid="be44e520761a493aab4b2a5973edd39c">tempest-AttachVolumeNegativeTest-630141842-project-member</nova:user>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:project uuid="52ce3a633ff54025aebcee0c30986ad9">tempest-AttachVolumeNegativeTest-630141842</nova:project>
Aug 16 10:34:52 user nova-compute[73067]:       </nova:owner>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:ports>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:port uuid="23ba3836-0532-4a97-aa9c-2fdbf6cbef26">
Aug 16 10:34:52 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 10:34:52 user nova-compute[73067]:         </nova:port>
Aug 16 10:34:52 user nova-compute[73067]:       </nova:ports>
Aug 16 10:34:52 user nova-compute[73067]:     </nova:instance>
Aug 16 10:34:52 user nova-compute[73067]:   </metadata>
Aug 16 10:34:52 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:34:52 user nova-compute[73067]:     <system>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="serial">2448aa3f-a0a6-43c6-8844-dbfb8145d779</entry>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="uuid">2448aa3f-a0a6-43c6-8844-dbfb8145d779</entry>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:34:52 user nova-compute[73067]:     </system>
Aug 16 10:34:52 user nova-compute[73067]:   </sysinfo>
Aug 16 10:34:52 user nova-compute[73067]:   <os>
Aug 16 10:34:52 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:34:52 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:34:52 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:34:52 user nova-compute[73067]:   </os>
Aug 16 10:34:52 user nova-compute[73067]:   <features>
Aug 16 10:34:52 user nova-compute[73067]:     <acpi/>
Aug 16 10:34:52 user nova-compute[73067]:     <apic/>
Aug 16 10:34:52 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:34:52 user nova-compute[73067]:   </features>
Aug 16 10:34:52 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:34:52 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:34:52 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:34:52 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:34:52 user nova-compute[73067]:   </clock>
Aug 16 10:34:52 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:34:52 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:34:52 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:34:52 user nova-compute[73067]:   </cpu>
Aug 16 10:34:52 user nova-compute[73067]:   <devices>
Aug 16 10:34:52 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:34:52 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:34:52 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk"/>
Aug 16 10:34:52 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:34:52 user nova-compute[73067]:     </disk>
Aug 16 10:34:52 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:34:52 user nova-compute[73067]:       <mac address="fa:16:3e:ae:d4:32"/>
Aug 16 10:34:52 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:34:52 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:34:52 user nova-compute[73067]:       <target dev="tap23ba3836-05"/>
Aug 16 10:34:52 user nova-compute[73067]:     </interface>
Aug 16 10:34:52 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:34:52 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/console.log" append="off"/>
Aug 16 10:34:52 user nova-compute[73067]:     </serial>
Aug 16 10:34:52 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:34:52 user nova-compute[73067]:     <video>
Aug 16 10:34:52 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:34:52 user nova-compute[73067]:     </video>
Aug 16 10:34:52 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:34:52 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:34:52 user nova-compute[73067]:     </rng>
Aug 16 10:34:52 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:34:52 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:34:52 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:34:52 user nova-compute[73067]:     </memballoon>
Aug 16 10:34:52 user nova-compute[73067]:   </devices>
Aug 16 10:34:52 user nova-compute[73067]: </domain>
Aug 16 10:34:52 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1884560080',display_name='tempest-AttachVolumeNegativeTest-server-1884560080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1884560080',id=18,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRN+t+EoHP67fhfeMSFGoswweiFsS03ZZwJDwBe7aC5BOqV+MymEmmAqtSDZxJFTsM3PMTtPGDUEf/9PcFo7R54kr9NOczPbdigkMQnXYD1TnEoA7NIm2cTFVUVsoF4gQ==',key_name='tempest-keypair-1298336385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-0pqgplmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=2448aa3f-a0a6-43c6-8844-dbfb8145d779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d4:32,bridge_name='br-int',has_traffic_filtering=True,id=23ba3836-0532-4a97-aa9c-2fdbf6cbef26,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ba3836-05') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG os_vif [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d4:32,bridge_name='br-int',has_traffic_filtering=True,id=23ba3836-0532-4a97-aa9c-2fdbf6cbef26,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ba3836-05') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23ba3836-05, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23ba3836-05, col_values=(('external_ids', {'iface-id': '23ba3836-0532-4a97-aa9c-2fdbf6cbef26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:d4:32', 'vm-uuid': '2448aa3f-a0a6-43c6-8844-dbfb8145d779'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:52 user nova-compute[73067]: INFO os_vif [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d4:32,bridge_name='br-int',has_traffic_filtering=True,id=23ba3836-0532-4a97-aa9c-2fdbf6cbef26,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ba3836-05')
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updating instance_info_cache with network_info: [{"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Releasing lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Instance network_info: |[{"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Start _get_guest_xml network_info=[{"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No VIF found with MAC fa:16:3e:ae:d4:32, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:34:52 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:34:52 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1411715053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1411715053',id=19,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-p8ddrnk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:34:47Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=a9bb7311-5960-4a6f-8635-bd3fd7bc30d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf5dd87-9e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.objects.instance [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'pci_devices' on Instance uuid a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:34:52 user nova-compute[73067]:   <uuid>a9bb7311-5960-4a6f-8635-bd3fd7bc30d1</uuid>
Aug 16 10:34:52 user nova-compute[73067]:   <name>instance-00000013</name>
Aug 16 10:34:52 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:34:52 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:34:52 user nova-compute[73067]:   <metadata>
Aug 16 10:34:52 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:34:52 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1411715053</nova:name>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:34:52</nova:creationTime>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:34:52 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:34:52 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:owner>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:user uuid="d3b135edcf064595b8d93052903696a7">tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member</nova:user>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:project uuid="4d03e64450654fd693d6a1bd43017880">tempest-ServerBootFromVolumeStableRescueTest-1973630968</nova:project>
Aug 16 10:34:52 user nova-compute[73067]:       </nova:owner>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:34:52 user nova-compute[73067]:       <nova:ports>
Aug 16 10:34:52 user nova-compute[73067]:         <nova:port uuid="2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40">
Aug 16 10:34:52 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 10:34:52 user nova-compute[73067]:         </nova:port>
Aug 16 10:34:52 user nova-compute[73067]:       </nova:ports>
Aug 16 10:34:52 user nova-compute[73067]:     </nova:instance>
Aug 16 10:34:52 user nova-compute[73067]:   </metadata>
Aug 16 10:34:52 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:34:52 user nova-compute[73067]:     <system>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="serial">a9bb7311-5960-4a6f-8635-bd3fd7bc30d1</entry>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="uuid">a9bb7311-5960-4a6f-8635-bd3fd7bc30d1</entry>
Aug 16 10:34:52 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:34:52 user nova-compute[73067]:     </system>
Aug 16 10:34:52 user nova-compute[73067]:   </sysinfo>
Aug 16 10:34:52 user nova-compute[73067]:   <os>
Aug 16 10:34:52 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:34:52 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:34:52 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:34:52 user nova-compute[73067]:   </os>
Aug 16 10:34:52 user nova-compute[73067]:   <features>
Aug 16 10:34:52 user nova-compute[73067]:     <acpi/>
Aug 16 10:34:52 user nova-compute[73067]:     <apic/>
Aug 16 10:34:52 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:34:52 user nova-compute[73067]:   </features>
Aug 16 10:34:52 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:34:52 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:34:52 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:34:52 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:34:52 user nova-compute[73067]:   </clock>
Aug 16 10:34:52 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:34:52 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:34:52 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:34:52 user nova-compute[73067]:   </cpu>
Aug 16 10:34:52 user nova-compute[73067]:   <devices>
Aug 16 10:34:52 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:34:52 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:34:52 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk"/>
Aug 16 10:34:52 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:34:52 user nova-compute[73067]:     </disk>
Aug 16 10:34:52 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:34:52 user nova-compute[73067]:       <mac address="fa:16:3e:85:34:2a"/>
Aug 16 10:34:52 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:34:52 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:34:52 user nova-compute[73067]:       <target dev="tap2bf5dd87-9e"/>
Aug 16 10:34:52 user nova-compute[73067]:     </interface>
Aug 16 10:34:52 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:34:52 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/console.log" append="off"/>
Aug 16 10:34:52 user nova-compute[73067]:     </serial>
Aug 16 10:34:52 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:34:52 user nova-compute[73067]:     <video>
Aug 16 10:34:52 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:34:52 user nova-compute[73067]:     </video>
Aug 16 10:34:52 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:34:52 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:34:52 user nova-compute[73067]:     </rng>
Aug 16 10:34:52 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:34:52 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:34:52 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:34:52 user nova-compute[73067]:     </memballoon>
Aug 16 10:34:52 user nova-compute[73067]:   </devices>
Aug 16 10:34:52 user nova-compute[73067]: </domain>
Aug 16 10:34:52 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1411715053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1411715053',id=19,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-p8ddrnk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:34:47Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=a9bb7311-5960-4a6f-8635-bd3fd7bc30d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf5dd87-9e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG os_vif [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf5dd87-9e') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bf5dd87-9e, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bf5dd87-9e, col_values=(('external_ids', {'iface-id': '2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:34:2a', 'vm-uuid': 'a9bb7311-5960-4a6f-8635-bd3fd7bc30d1'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:52 user nova-compute[73067]: INFO os_vif [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf5dd87-9e')
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No VIF found with MAC fa:16:3e:85:34:2a, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.neutron [req-830d24ad-435d-4162-9c44-d2528974633a req-495cf545-a6a6-41b3-aee5-3bac0a702de6 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Updated VIF entry in instance network info cache for port 23ba3836-0532-4a97-aa9c-2fdbf6cbef26. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG nova.network.neutron [req-830d24ad-435d-4162-9c44-d2528974633a req-495cf545-a6a6-41b3-aee5-3bac0a702de6 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Updating instance_info_cache with network_info: [{"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-830d24ad-435d-4162-9c44-d2528974633a req-495cf545-a6a6-41b3-aee5-3bac0a702de6 service nova] Releasing lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG nova.compute.manager [req-808dbc25-63cb-4392-bb2f-4fa927db4ad0 req-96b8c35a-b073-4742-b657-a2376301f704 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Received event network-changed-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG nova.compute.manager [req-808dbc25-63cb-4392-bb2f-4fa927db4ad0 req-96b8c35a-b073-4742-b657-a2376301f704 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Refreshing instance network info cache due to event network-changed-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-808dbc25-63cb-4392-bb2f-4fa927db4ad0 req-96b8c35a-b073-4742-b657-a2376301f704 service nova] Acquiring lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-808dbc25-63cb-4392-bb2f-4fa927db4ad0 req-96b8c35a-b073-4742-b657-a2376301f704 service nova] Acquired lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:34:53 user nova-compute[73067]: DEBUG nova.network.neutron [req-808dbc25-63cb-4392-bb2f-4fa927db4ad0 req-96b8c35a-b073-4742-b657-a2376301f704 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Refreshing network info cache for port 2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:34:54 user nova-compute[73067]: DEBUG nova.network.neutron [req-808dbc25-63cb-4392-bb2f-4fa927db4ad0 req-96b8c35a-b073-4742-b657-a2376301f704 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updated VIF entry in instance network info cache for port 2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:34:54 user nova-compute[73067]: DEBUG nova.network.neutron [req-808dbc25-63cb-4392-bb2f-4fa927db4ad0 req-96b8c35a-b073-4742-b657-a2376301f704 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updating instance_info_cache with network_info: [{"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:34:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-808dbc25-63cb-4392-bb2f-4fa927db4ad0 req-96b8c35a-b073-4742-b657-a2376301f704 service nova] Releasing lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received event network-vif-plugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] No waiting events found dispatching network-vif-plugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:34:55 user nova-compute[73067]: WARNING nova.compute.manager [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received unexpected event network-vif-plugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 for instance with vm_state building and task_state spawning.
Aug 16 10:34:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received event network-vif-plugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] No waiting events found dispatching network-vif-plugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:34:55 user nova-compute[73067]: WARNING nova.compute.manager [req-05b19bf7-7de7-4970-b6ca-d946c389ff2e req-509778be-c92f-472b-a23a-458ae1b86f57 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received unexpected event network-vif-plugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 for instance with vm_state building and task_state spawning.
Aug 16 10:34:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-e242e803-80f6-4b6a-bc61-fa8cb530afe5 req-06e64d74-8f0b-451b-a61c-e4f020b62e48 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Received event network-vif-plugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e242e803-80f6-4b6a-bc61-fa8cb530afe5 req-06e64d74-8f0b-451b-a61c-e4f020b62e48 service nova] Acquiring lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e242e803-80f6-4b6a-bc61-fa8cb530afe5 req-06e64d74-8f0b-451b-a61c-e4f020b62e48 service nova] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e242e803-80f6-4b6a-bc61-fa8cb530afe5 req-06e64d74-8f0b-451b-a61c-e4f020b62e48 service nova] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-e242e803-80f6-4b6a-bc61-fa8cb530afe5 req-06e64d74-8f0b-451b-a61c-e4f020b62e48 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] No waiting events found dispatching network-vif-plugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:34:56 user nova-compute[73067]: WARNING nova.compute.manager [req-e242e803-80f6-4b6a-bc61-fa8cb530afe5 req-06e64d74-8f0b-451b-a61c-e4f020b62e48 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Received unexpected event network-vif-plugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 for instance with vm_state building and task_state spawning.
Aug 16 10:34:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received event network-vif-plugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] No waiting events found dispatching network-vif-plugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:34:58 user nova-compute[73067]: WARNING nova.compute.manager [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received unexpected event network-vif-plugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 for instance with vm_state building and task_state spawning.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received event network-vif-plugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] No waiting events found dispatching network-vif-plugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:34:58 user nova-compute[73067]: WARNING nova.compute.manager [req-858101f5-256a-475e-aa01-36219a2f0795 req-bc158797-60ee-4b15-830b-11ed5dd1a417 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received unexpected event network-vif-plugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 for instance with vm_state building and task_state spawning.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a14a1190-d83d-49da-b918-34cbfdda4e85 req-0f3f3c40-7c3d-476a-ae2b-7af79e136966 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Received event network-vif-plugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a14a1190-d83d-49da-b918-34cbfdda4e85 req-0f3f3c40-7c3d-476a-ae2b-7af79e136966 service nova] Acquiring lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a14a1190-d83d-49da-b918-34cbfdda4e85 req-0f3f3c40-7c3d-476a-ae2b-7af79e136966 service nova] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a14a1190-d83d-49da-b918-34cbfdda4e85 req-0f3f3c40-7c3d-476a-ae2b-7af79e136966 service nova] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-a14a1190-d83d-49da-b918-34cbfdda4e85 req-0f3f3c40-7c3d-476a-ae2b-7af79e136966 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] No waiting events found dispatching network-vif-plugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:34:58 user nova-compute[73067]: WARNING nova.compute.manager [req-a14a1190-d83d-49da-b918-34cbfdda4e85 req-0f3f3c40-7c3d-476a-ae2b-7af79e136966 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Received unexpected event network-vif-plugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 for instance with vm_state building and task_state spawning.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182098.2967322, fcb6379a-4c57-462b-a4ea-9680340a5137 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] VM Resumed (Lifecycle Event)
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Instance spawned successfully.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182098.2971158, fcb6379a-4c57-462b-a4ea-9680340a5137 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] VM Started (Lifecycle Event)
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Took 9.48 seconds to spawn the instance on the hypervisor.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Took 10.44 seconds to build instance.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-41c7f572-b502-4585-bf12-0f80129c8ccb tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.567s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182098.8315642, 2448aa3f-a0a6-43c6-8844-dbfb8145d779 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] VM Resumed (Lifecycle Event)
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Instance spawned successfully.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182098.841608, 2448aa3f-a0a6-43c6-8844-dbfb8145d779 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] VM Started (Lifecycle Event)
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Instance spawned successfully.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:34:58 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182098.8739185, a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:34:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] VM Resumed (Lifecycle Event)
Aug 16 10:34:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:59 user nova-compute[73067]: INFO nova.compute.manager [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Took 12.43 seconds to spawn the instance on the hypervisor.
Aug 16 10:34:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:34:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:34:59 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182098.8813298, a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:34:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] VM Started (Lifecycle Event)
Aug 16 10:34:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:34:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:34:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Took 11.53 seconds to spawn the instance on the hypervisor.
Aug 16 10:34:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:34:59 user nova-compute[73067]: INFO nova.compute.manager [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Took 13.32 seconds to build instance.
Aug 16 10:34:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c0987d2-6ecd-4d49-a415-930931268f67 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.441s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Took 12.82 seconds to build instance.
Aug 16 10:34:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c5d134c-9d65-412e-a398-eb638bd83725 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.951s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:34:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:34:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:34:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:34:59 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:34:59 user nova-compute[73067]: INFO nova.compute.claims [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Claim successful on node user
Aug 16 10:35:00 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.764s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG nova.network.neutron [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:35:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:35:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG nova.policy [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f31fb1d402eb4b20a235bde81abf368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02fb79aa19c4aeea8a34020239ff480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:35:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Creating image(s)
Aug 16 10:35:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "/opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "/opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.226s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.287s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk 1073741824" returned: 0 in 0.086s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.381s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG nova.network.neutron [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Successfully created port: b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.264s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Cannot resize image /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:35:01 user nova-compute[73067]: DEBUG nova.objects.instance [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lazy-loading 'migration_context' on Instance uuid 0f85b78e-78c3-4e5a-a33d-ace04474a737 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Ensure instance console log exists: /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "2f25b2a2-25fd-4146-abba-152967481a01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "2f25b2a2-25fd-4146-abba-152967481a01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "2f25b2a2-25fd-4146-abba-152967481a01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "2f25b2a2-25fd-4146-abba-152967481a01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "2f25b2a2-25fd-4146-abba-152967481a01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:02 user nova-compute[73067]: INFO nova.compute.manager [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Terminating instance
Aug 16 10:35:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-db1db93f-a988-4ec2-8d99-8ac4b5b31f56 req-7e68df0e-41c6-467e-921f-4703e28e98cc service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Received event network-vif-unplugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-db1db93f-a988-4ec2-8d99-8ac4b5b31f56 req-7e68df0e-41c6-467e-921f-4703e28e98cc service nova] Acquiring lock "2f25b2a2-25fd-4146-abba-152967481a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-db1db93f-a988-4ec2-8d99-8ac4b5b31f56 req-7e68df0e-41c6-467e-921f-4703e28e98cc service nova] Lock "2f25b2a2-25fd-4146-abba-152967481a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-db1db93f-a988-4ec2-8d99-8ac4b5b31f56 req-7e68df0e-41c6-467e-921f-4703e28e98cc service nova] Lock "2f25b2a2-25fd-4146-abba-152967481a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-db1db93f-a988-4ec2-8d99-8ac4b5b31f56 req-7e68df0e-41c6-467e-921f-4703e28e98cc service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] No waiting events found dispatching network-vif-unplugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-db1db93f-a988-4ec2-8d99-8ac4b5b31f56 req-7e68df0e-41c6-467e-921f-4703e28e98cc service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Received event network-vif-unplugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:02 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Instance destroyed successfully.
Aug 16 10:35:02 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lazy-loading 'resources' on Instance uuid 2f25b2a2-25fd-4146-abba-152967481a01 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1515172778',display_name='tempest-VolumesActionsTest-instance-1515172778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1515172778',id=15,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:33:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='170bcb24cdf44e63ad5f42259b9c470c',ramdisk_id='',reservation_id='r-0xqfmsqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-811248869',owner_user_name='tempest-VolumesActionsTest-811248869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:33:20Z,user_data=None,user_id='586e0de6f261403fa757b2da4b578f8b',uuid=2f25b2a2-25fd-4146-abba-152967481a01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "address": "fa:16:3e:79:42:07", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5f8a13-d5", "ovs_interfaceid": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converting VIF {"id": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "address": "fa:16:3e:79:42:07", "network": {"id": "4415f9d7-acc5-43c3-af85-2250745af259", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1339990017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170bcb24cdf44e63ad5f42259b9c470c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5f8a13-d5", "ovs_interfaceid": "5d5f8a13-d5ea-4daf-89c7-379b5d8a05da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:42:07,bridge_name='br-int',has_traffic_filtering=True,id=5d5f8a13-d5ea-4daf-89c7-379b5d8a05da,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5f8a13-d5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG os_vif [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:42:07,bridge_name='br-int',has_traffic_filtering=True,id=5d5f8a13-d5ea-4daf-89c7-379b5d8a05da,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5f8a13-d5') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d5f8a13-d5, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:35:02 user nova-compute[73067]: INFO os_vif [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:42:07,bridge_name='br-int',has_traffic_filtering=True,id=5d5f8a13-d5ea-4daf-89c7-379b5d8a05da,network=Network(4415f9d7-acc5-43c3-af85-2250745af259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5f8a13-d5')
Aug 16 10:35:02 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Deleting instance files /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01_del
Aug 16 10:35:02 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Deletion of /opt/stack/data/nova/instances/2f25b2a2-25fd-4146-abba-152967481a01_del complete
Aug 16 10:35:03 user nova-compute[73067]: INFO nova.compute.manager [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 16 10:35:03 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Successfully updated port: b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "refresh_cache-0f85b78e-78c3-4e5a-a33d-ace04474a737" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquired lock "refresh_cache-0f85b78e-78c3-4e5a-a33d-ace04474a737" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.compute.manager [req-74803ec6-856b-4b39-b2a5-ef3320f68669 req-d72dcee6-ca0c-430e-ab24-dcc56f4a8ba6 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received event network-changed-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.compute.manager [req-74803ec6-856b-4b39-b2a5-ef3320f68669 req-d72dcee6-ca0c-430e-ab24-dcc56f4a8ba6 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Refreshing instance network info cache due to event network-changed-b72f8a84-e264-4da0-b7da-0ab8750b046a. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-74803ec6-856b-4b39-b2a5-ef3320f68669 req-d72dcee6-ca0c-430e-ab24-dcc56f4a8ba6 service nova] Acquiring lock "refresh_cache-0f85b78e-78c3-4e5a-a33d-ace04474a737" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:03 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Took 0.85 seconds to deallocate network for instance.
Aug 16 10:35:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Updating instance_info_cache with network_info: [{"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Releasing lock "refresh_cache-0f85b78e-78c3-4e5a-a33d-ace04474a737" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Instance network_info: |[{"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-74803ec6-856b-4b39-b2a5-ef3320f68669 req-d72dcee6-ca0c-430e-ab24-dcc56f4a8ba6 service nova] Acquired lock "refresh_cache-0f85b78e-78c3-4e5a-a33d-ace04474a737" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.network.neutron [req-74803ec6-856b-4b39-b2a5-ef3320f68669 req-d72dcee6-ca0c-430e-ab24-dcc56f4a8ba6 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Refreshing network info cache for port b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:35:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Start _get_guest_xml network_info=[{"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:35:03 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:35:03 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1026129227',display_name='tempest-TestVolumeSwap-server-1026129227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1026129227',id=21,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWenRzgcPaYxFS7ODvS2pu0Ffqc8vamYfRa1ZYUknjgNhOzeFmelfh0JP8oDceVdIHJOY+9fEe9DYm56PCYFah7ZUzTCS1Se4H144dV9hgS3fIa6TfzgqbgAR6qM68ddw==',key_name='tempest-keypair-1931619155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d02fb79aa19c4aeea8a34020239ff480',ramdisk_id='',reservation_id='r-4j1su4fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-690063517',owner_user_name='tempest-TestVolumeSwap-690063517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:35:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f31fb1d402eb4b20a235bde81abf368a',uuid=0f85b78e-78c3-4e5a-a33d-ace04474a737,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Converting VIF {"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:13,bridge_name='br-int',has_traffic_filtering=True,id=b72f8a84-e264-4da0-b7da-0ab8750b046a,network=Network(51197f16-755c-4fca-a0a8-75bf5b5444ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72f8a84-e2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.objects.instance [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f85b78e-78c3-4e5a-a33d-ace04474a737 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:35:04 user nova-compute[73067]:   <uuid>0f85b78e-78c3-4e5a-a33d-ace04474a737</uuid>
Aug 16 10:35:04 user nova-compute[73067]:   <name>instance-00000015</name>
Aug 16 10:35:04 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:35:04 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:35:04 user nova-compute[73067]:   <metadata>
Aug 16 10:35:04 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:35:04 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:35:04 user nova-compute[73067]:       <nova:name>tempest-TestVolumeSwap-server-1026129227</nova:name>
Aug 16 10:35:04 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:35:04</nova:creationTime>
Aug 16 10:35:04 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:35:04 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:35:04 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:35:04 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:35:04 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:35:04 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:35:04 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:35:04 user nova-compute[73067]:       <nova:owner>
Aug 16 10:35:04 user nova-compute[73067]:         <nova:user uuid="f31fb1d402eb4b20a235bde81abf368a">tempest-TestVolumeSwap-690063517-project-member</nova:user>
Aug 16 10:35:04 user nova-compute[73067]:         <nova:project uuid="d02fb79aa19c4aeea8a34020239ff480">tempest-TestVolumeSwap-690063517</nova:project>
Aug 16 10:35:04 user nova-compute[73067]:       </nova:owner>
Aug 16 10:35:04 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:35:04 user nova-compute[73067]:       <nova:ports>
Aug 16 10:35:04 user nova-compute[73067]:         <nova:port uuid="b72f8a84-e264-4da0-b7da-0ab8750b046a">
Aug 16 10:35:04 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 10:35:04 user nova-compute[73067]:         </nova:port>
Aug 16 10:35:04 user nova-compute[73067]:       </nova:ports>
Aug 16 10:35:04 user nova-compute[73067]:     </nova:instance>
Aug 16 10:35:04 user nova-compute[73067]:   </metadata>
Aug 16 10:35:04 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:35:04 user nova-compute[73067]:     <system>
Aug 16 10:35:04 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:35:04 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:35:04 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:35:04 user nova-compute[73067]:       <entry name="serial">0f85b78e-78c3-4e5a-a33d-ace04474a737</entry>
Aug 16 10:35:04 user nova-compute[73067]:       <entry name="uuid">0f85b78e-78c3-4e5a-a33d-ace04474a737</entry>
Aug 16 10:35:04 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:35:04 user nova-compute[73067]:     </system>
Aug 16 10:35:04 user nova-compute[73067]:   </sysinfo>
Aug 16 10:35:04 user nova-compute[73067]:   <os>
Aug 16 10:35:04 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:35:04 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:35:04 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:35:04 user nova-compute[73067]:   </os>
Aug 16 10:35:04 user nova-compute[73067]:   <features>
Aug 16 10:35:04 user nova-compute[73067]:     <acpi/>
Aug 16 10:35:04 user nova-compute[73067]:     <apic/>
Aug 16 10:35:04 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:35:04 user nova-compute[73067]:   </features>
Aug 16 10:35:04 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:35:04 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:35:04 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:35:04 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:35:04 user nova-compute[73067]:   </clock>
Aug 16 10:35:04 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:35:04 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:35:04 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:35:04 user nova-compute[73067]:   </cpu>
Aug 16 10:35:04 user nova-compute[73067]:   <devices>
Aug 16 10:35:04 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:35:04 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:35:04 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk"/>
Aug 16 10:35:04 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:35:04 user nova-compute[73067]:     </disk>
Aug 16 10:35:04 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:35:04 user nova-compute[73067]:       <mac address="fa:16:3e:45:38:13"/>
Aug 16 10:35:04 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:35:04 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:35:04 user nova-compute[73067]:       <target dev="tapb72f8a84-e2"/>
Aug 16 10:35:04 user nova-compute[73067]:     </interface>
Aug 16 10:35:04 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:35:04 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/console.log" append="off"/>
Aug 16 10:35:04 user nova-compute[73067]:     </serial>
Aug 16 10:35:04 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:35:04 user nova-compute[73067]:     <video>
Aug 16 10:35:04 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:35:04 user nova-compute[73067]:     </video>
Aug 16 10:35:04 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:35:04 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:35:04 user nova-compute[73067]:     </rng>
Aug 16 10:35:04 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:35:04 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:35:04 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:35:04 user nova-compute[73067]:     </memballoon>
Aug 16 10:35:04 user nova-compute[73067]:   </devices>
Aug 16 10:35:04 user nova-compute[73067]: </domain>
Aug 16 10:35:04 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1026129227',display_name='tempest-TestVolumeSwap-server-1026129227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1026129227',id=21,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWenRzgcPaYxFS7ODvS2pu0Ffqc8vamYfRa1ZYUknjgNhOzeFmelfh0JP8oDceVdIHJOY+9fEe9DYm56PCYFah7ZUzTCS1Se4H144dV9hgS3fIa6TfzgqbgAR6qM68ddw==',key_name='tempest-keypair-1931619155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d02fb79aa19c4aeea8a34020239ff480',ramdisk_id='',reservation_id='r-4j1su4fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-690063517',owner_user_name='tempest-TestVolumeSwap-690063517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:35:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f31fb1d402eb4b20a235bde81abf368a',uuid=0f85b78e-78c3-4e5a-a33d-ace04474a737,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Converting VIF {"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:13,bridge_name='br-int',has_traffic_filtering=True,id=b72f8a84-e264-4da0-b7da-0ab8750b046a,network=Network(51197f16-755c-4fca-a0a8-75bf5b5444ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72f8a84-e2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG os_vif [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:13,bridge_name='br-int',has_traffic_filtering=True,id=b72f8a84-e264-4da0-b7da-0ab8750b046a,network=Network(51197f16-755c-4fca-a0a8-75bf5b5444ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72f8a84-e2') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb72f8a84-e2, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb72f8a84-e2, col_values=(('external_ids', {'iface-id': 'b72f8a84-e264-4da0-b7da-0ab8750b046a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:38:13', 'vm-uuid': '0f85b78e-78c3-4e5a-a33d-ace04474a737'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:04 user nova-compute[73067]: INFO os_vif [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:13,bridge_name='br-int',has_traffic_filtering=True,id=b72f8a84-e264-4da0-b7da-0ab8750b046a,network=Network(51197f16-755c-4fca-a0a8-75bf5b5444ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72f8a84-e2')
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] No VIF found with MAC fa:16:3e:45:38:13, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.689s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:04 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Deleted allocations for instance 2f25b2a2-25fd-4146-abba-152967481a01
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-16418693-7266-4646-bcd6-c20ae22d95c4 req-0cd4a204-1cf2-4502-a739-60d353e48479 service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Received event network-vif-plugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16418693-7266-4646-bcd6-c20ae22d95c4 req-0cd4a204-1cf2-4502-a739-60d353e48479 service nova] Acquiring lock "2f25b2a2-25fd-4146-abba-152967481a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16418693-7266-4646-bcd6-c20ae22d95c4 req-0cd4a204-1cf2-4502-a739-60d353e48479 service nova] Lock "2f25b2a2-25fd-4146-abba-152967481a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16418693-7266-4646-bcd6-c20ae22d95c4 req-0cd4a204-1cf2-4502-a739-60d353e48479 service nova] Lock "2f25b2a2-25fd-4146-abba-152967481a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-16418693-7266-4646-bcd6-c20ae22d95c4 req-0cd4a204-1cf2-4502-a739-60d353e48479 service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] No waiting events found dispatching network-vif-plugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:04 user nova-compute[73067]: WARNING nova.compute.manager [req-16418693-7266-4646-bcd6-c20ae22d95c4 req-0cd4a204-1cf2-4502-a739-60d353e48479 service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Received unexpected event network-vif-plugged-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da for instance with vm_state deleted and task_state None.
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-74803ec6-856b-4b39-b2a5-ef3320f68669 req-d72dcee6-ca0c-430e-ab24-dcc56f4a8ba6 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Updated VIF entry in instance network info cache for port b72f8a84-e264-4da0-b7da-0ab8750b046a. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-74803ec6-856b-4b39-b2a5-ef3320f68669 req-d72dcee6-ca0c-430e-ab24-dcc56f4a8ba6 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Updating instance_info_cache with network_info: [{"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-74803ec6-856b-4b39-b2a5-ef3320f68669 req-d72dcee6-ca0c-430e-ab24-dcc56f4a8ba6 service nova] Releasing lock "refresh_cache-0f85b78e-78c3-4e5a-a33d-ace04474a737" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:35:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5a583d9c-5866-4f85-a306-0d59bbda0f0c tempest-VolumesActionsTest-811248869 tempest-VolumesActionsTest-811248869-project-member] Lock "2f25b2a2-25fd-4146-abba-152967481a01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.665s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:05 user nova-compute[73067]: DEBUG nova.compute.manager [req-ece26c91-c56b-4fd8-b503-ecce5c7edd98 req-9f1ab43d-bc26-4eed-a645-29e065a1e4b0 service nova] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Received event network-vif-deleted-5d5f8a13-d5ea-4daf-89c7-379b5d8a05da {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-2abefd7a-0561-495d-97d9-65f499b2eb39 req-572dfca7-3560-471a-9e63-8987f4e085f3 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received event network-vif-plugged-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2abefd7a-0561-495d-97d9-65f499b2eb39 req-572dfca7-3560-471a-9e63-8987f4e085f3 service nova] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2abefd7a-0561-495d-97d9-65f499b2eb39 req-572dfca7-3560-471a-9e63-8987f4e085f3 service nova] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2abefd7a-0561-495d-97d9-65f499b2eb39 req-572dfca7-3560-471a-9e63-8987f4e085f3 service nova] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-2abefd7a-0561-495d-97d9-65f499b2eb39 req-572dfca7-3560-471a-9e63-8987f4e085f3 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] No waiting events found dispatching network-vif-plugged-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:06 user nova-compute[73067]: WARNING nova.compute.manager [req-2abefd7a-0561-495d-97d9-65f499b2eb39 req-572dfca7-3560-471a-9e63-8987f4e085f3 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received unexpected event network-vif-plugged-b72f8a84-e264-4da0-b7da-0ab8750b046a for instance with vm_state building and task_state spawning.
Aug 16 10:35:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-3651f61f-cdfd-4ee4-a457-e678d1188a0c req-1bb5083c-2463-4d32-b620-5f0bdcc709e6 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received event network-vif-plugged-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3651f61f-cdfd-4ee4-a457-e678d1188a0c req-1bb5083c-2463-4d32-b620-5f0bdcc709e6 service nova] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3651f61f-cdfd-4ee4-a457-e678d1188a0c req-1bb5083c-2463-4d32-b620-5f0bdcc709e6 service nova] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3651f61f-cdfd-4ee4-a457-e678d1188a0c req-1bb5083c-2463-4d32-b620-5f0bdcc709e6 service nova] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-3651f61f-cdfd-4ee4-a457-e678d1188a0c req-1bb5083c-2463-4d32-b620-5f0bdcc709e6 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] No waiting events found dispatching network-vif-plugged-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:08 user nova-compute[73067]: WARNING nova.compute.manager [req-3651f61f-cdfd-4ee4-a457-e678d1188a0c req-1bb5083c-2463-4d32-b620-5f0bdcc709e6 service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received unexpected event network-vif-plugged-b72f8a84-e264-4da0-b7da-0ab8750b046a for instance with vm_state building and task_state spawning.
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182108.416946, 0f85b78e-78c3-4e5a-a33d-ace04474a737 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:35:08 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] VM Resumed (Lifecycle Event)
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:35:08 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Instance spawned successfully.
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:08 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182108.4170682, 0f85b78e-78c3-4e5a-a33d-ace04474a737 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:35:08 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] VM Started (Lifecycle Event)
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:35:08 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:35:08 user nova-compute[73067]: INFO nova.compute.manager [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Took 8.00 seconds to spawn the instance on the hypervisor.
Aug 16 10:35:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:08 user nova-compute[73067]: INFO nova.compute.manager [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Took 9.25 seconds to build instance.
Aug 16 10:35:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-af8cc1a2-1590-4fc1-8f02-1ac537657975 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.531s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "f7014e03-d278-40cf-8a7b-c798d76c87b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:14 user nova-compute[73067]: INFO nova.compute.manager [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Terminating instance
Aug 16 10:35:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:35:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-40e32b60-1969-4226-93a9-d22d87b64448 req-ed1d2786-6c35-4703-990b-a3e074b3ae8a service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Received event network-vif-unplugged-c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-40e32b60-1969-4226-93a9-d22d87b64448 req-ed1d2786-6c35-4703-990b-a3e074b3ae8a service nova] Acquiring lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-40e32b60-1969-4226-93a9-d22d87b64448 req-ed1d2786-6c35-4703-990b-a3e074b3ae8a service nova] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-40e32b60-1969-4226-93a9-d22d87b64448 req-ed1d2786-6c35-4703-990b-a3e074b3ae8a service nova] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-40e32b60-1969-4226-93a9-d22d87b64448 req-ed1d2786-6c35-4703-990b-a3e074b3ae8a service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] No waiting events found dispatching network-vif-unplugged-c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-40e32b60-1969-4226-93a9-d22d87b64448 req-ed1d2786-6c35-4703-990b-a3e074b3ae8a service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Received event network-vif-unplugged-c96e297b-67f9-41f9-b396-87710eb267bc for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:15 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Instance destroyed successfully.
Aug 16 10:35:15 user nova-compute[73067]: DEBUG nova.objects.instance [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lazy-loading 'resources' on Instance uuid f7014e03-d278-40cf-8a7b-c798d76c87b0 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-766796936',display_name='tempest-VolumesAdminNegativeTest-server-766796936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-766796936',id=14,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:33:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82e7f124a2a74ac482ff13de710ba04a',ramdisk_id='',reservation_id='r-b2sbd78o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1324591370',owner_user_name='tempest-VolumesAdminNegativeTest-1324591370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:33:14Z,user_data=None,user_id='b63f9ed0b5294eaf8919cf4c9bcea4ea',uuid=f7014e03-d278-40cf-8a7b-c798d76c87b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c96e297b-67f9-41f9-b396-87710eb267bc", "address": "fa:16:3e:97:29:19", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96e297b-67", "ovs_interfaceid": "c96e297b-67f9-41f9-b396-87710eb267bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converting VIF {"id": "c96e297b-67f9-41f9-b396-87710eb267bc", "address": "fa:16:3e:97:29:19", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96e297b-67", "ovs_interfaceid": "c96e297b-67f9-41f9-b396-87710eb267bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:29:19,bridge_name='br-int',has_traffic_filtering=True,id=c96e297b-67f9-41f9-b396-87710eb267bc,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96e297b-67') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG os_vif [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:29:19,bridge_name='br-int',has_traffic_filtering=True,id=c96e297b-67f9-41f9-b396-87710eb267bc,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96e297b-67') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc96e297b-67, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:35:15 user nova-compute[73067]: INFO os_vif [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:29:19,bridge_name='br-int',has_traffic_filtering=True,id=c96e297b-67f9-41f9-b396-87710eb267bc,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96e297b-67')
Aug 16 10:35:15 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Deleting instance files /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0_del
Aug 16 10:35:15 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Deletion of /opt/stack/data/nova/instances/f7014e03-d278-40cf-8a7b-c798d76c87b0_del complete
Aug 16 10:35:15 user nova-compute[73067]: INFO nova.compute.manager [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 16 10:35:15 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:35:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:16 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:16 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Took 1.00 seconds to deallocate network for instance.
Aug 16 10:35:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:17 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:35:17 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:35:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:17 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Deleted allocations for instance f7014e03-d278-40cf-8a7b-c798d76c87b0
Aug 16 10:35:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-0823376a-2280-4f5c-a281-555b062f171b req-e42b5f07-ccee-49cb-bf6e-d1a775a4e03e service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Received event network-vif-plugged-c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0823376a-2280-4f5c-a281-555b062f171b req-e42b5f07-ccee-49cb-bf6e-d1a775a4e03e service nova] Acquiring lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0823376a-2280-4f5c-a281-555b062f171b req-e42b5f07-ccee-49cb-bf6e-d1a775a4e03e service nova] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0823376a-2280-4f5c-a281-555b062f171b req-e42b5f07-ccee-49cb-bf6e-d1a775a4e03e service nova] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-0823376a-2280-4f5c-a281-555b062f171b req-e42b5f07-ccee-49cb-bf6e-d1a775a4e03e service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] No waiting events found dispatching network-vif-plugged-c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:17 user nova-compute[73067]: WARNING nova.compute.manager [req-0823376a-2280-4f5c-a281-555b062f171b req-e42b5f07-ccee-49cb-bf6e-d1a775a4e03e service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Received unexpected event network-vif-plugged-c96e297b-67f9-41f9-b396-87710eb267bc for instance with vm_state deleted and task_state None.
Aug 16 10:35:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-0823376a-2280-4f5c-a281-555b062f171b req-e42b5f07-ccee-49cb-bf6e-d1a775a4e03e service nova] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Received event network-vif-deleted-c96e297b-67f9-41f9-b396-87710eb267bc {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaf35414-5593-477f-a32b-4f714f4c9564 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "f7014e03-d278-40cf-8a7b-c798d76c87b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.681s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:17 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182102.8604267, 2f25b2a2-25fd-4146-abba-152967481a01 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:35:17 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] VM Stopped (Lifecycle Event)
Aug 16 10:35:17 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9306f68d-2f17-4397-85f6-1d7052b86f50 None None] [instance: 2f25b2a2-25fd-4146-abba-152967481a01] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-840b624a-5dd8-412d-a206-016eb6fd7782 req-21afd0e6-4431-4d75-9463-da7e10be7a9a service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-changed-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-840b624a-5dd8-412d-a206-016eb6fd7782 req-21afd0e6-4431-4d75-9463-da7e10be7a9a service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Refreshing instance network info cache due to event network-changed-f4af474f-c83b-403b-abed-abaf9c0e71f8. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-840b624a-5dd8-412d-a206-016eb6fd7782 req-21afd0e6-4431-4d75-9463-da7e10be7a9a service nova] Acquiring lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-840b624a-5dd8-412d-a206-016eb6fd7782 req-21afd0e6-4431-4d75-9463-da7e10be7a9a service nova] Acquired lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG nova.network.neutron [req-840b624a-5dd8-412d-a206-016eb6fd7782 req-21afd0e6-4431-4d75-9463-da7e10be7a9a service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Refreshing network info cache for port f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG nova.objects.instance [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'flavor' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG nova.network.neutron [req-840b624a-5dd8-412d-a206-016eb6fd7782 req-21afd0e6-4431-4d75-9463-da7e10be7a9a service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Updated VIF entry in instance network info cache for port f4af474f-c83b-403b-abed-abaf9c0e71f8. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG nova.network.neutron [req-840b624a-5dd8-412d-a206-016eb6fd7782 req-21afd0e6-4431-4d75-9463-da7e10be7a9a service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Updating instance_info_cache with network_info: [{"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-840b624a-5dd8-412d-a206-016eb6fd7782 req-21afd0e6-4431-4d75-9463-da7e10be7a9a service nova] Releasing lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:21 user nova-compute[73067]: INFO nova.compute.manager [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Attaching volume ac2d0615-79f2-4f6d-9854-4857305ade6e to /dev/vdb
Aug 16 10:35:21 user nova-compute[73067]: DEBUG os_brick.utils [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c242388-aea9-41fd-a7a4-f7e0ff0ad217]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f195ffc0-88bc-4db0-8754-695d0c7e2934]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c325d759-b38a-4281-a170-d31f61e5100d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[611a88d2-4d91-4476-a7ff-3dad288818b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:35:22 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:35:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f510f2d-2fbe-4e7e-9bc5-37246ed14658]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG os_brick.utils [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:35:22 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Updating existing volume attachment record: e99c16bd-e22b-4815-a6ca-54eea14420b5 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:35:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:29 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182115.7788928, f7014e03-d278-40cf-8a7b-c798d76c87b0 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:35:30 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] VM Stopped (Lifecycle Event)
Aug 16 10:35:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-debff139-ca83-4916-8e13-25f8e63007b2 None None] [instance: f7014e03-d278-40cf-8a7b-c798d76c87b0] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:34 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:35:34 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=6949MB free_disk=25.421001434326172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b51879a0-d5a1-4f96-b0c1-0672d31e80db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cca10fa3-1289-4ee9-b1d8-fe37afc92960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ffe1f07d-0a48-431d-be98-7e78018faa10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6a791852-6268-4679-8b8f-e86eac3d5ad4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fcb6379a-4c57-462b-a4ea-9680340a5137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0f85b78e-78c3-4e5a-a33d-ace04474a737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:35:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKBWkqOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:35:35 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:35:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:35:35 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:35:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:35:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:35:35 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:35:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[47522d4d-dee8-4777-8d3e-252dc406e6a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:35:36 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[195d35b2-c8f8-4248-893e-a8fb8a696552]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e] added
Aug 16 10:35:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f8a934-1394-4226-96ec-6643f9c1d7e4]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[606631f5-0362-4363-80e1-36168bc3fa97]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vKBWkqOC {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vKBWkqOC" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a3de2a-879a-4c92-a302-71bdaee1eda9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vKBWkqOC'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[943f4845-3119-40df-92f6-da535d06ac1b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[069dd249-2dbd-43ca-ab7b-2aaa7a01c152]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:36 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:35:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:36 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:35:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da8ec30-c255-4262-a047-963a3a7c064e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260]
Aug 16 10:35:36 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260] successful.
Aug 16 10:35:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ba74cf-212c-4d19-88dc-18836da1d5dc]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6698840c-1931-42fc-8c62-15c3f2294d43]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:36 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:35:36 user nova-compute[73067]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:35:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:36 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:35:36 user nova-compute[73067]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:35:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d917ad45-cc9c-4d68-8d97-509e889e799b]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:35:36 user nova-compute[73067]: INFO nova.compute.manager [None req-ad908c14-c096-4b2a-b0be-9c0366f7ed08 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Unrescuing
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ad908c14-c096-4b2a-b0be-9c0366f7ed08 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ad908c14-c096-4b2a-b0be-9c0366f7ed08 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquired lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:35:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ad908c14-c096-4b2a-b0be-9c0366f7ed08 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ad908c14-c096-4b2a-b0be-9c0366f7ed08 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updating instance_info_cache with network_info: [{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ad908c14-c096-4b2a-b0be-9c0366f7ed08 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Releasing lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ad908c14-c096-4b2a-b0be-9c0366f7ed08 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'flavor' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKBWkqOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26437636439643565', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437636439643565', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG nova.objects.instance [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'flavor' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:35:37 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:35:37 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:35:37 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:35:37 user nova-compute[73067]:   <serial>ac2d0615-79f2-4f6d-9854-4857305ade6e</serial>
Aug 16 10:35:37 user nova-compute[73067]: </disk>
Aug 16 10:35:37 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No VIF found with MAC fa:16:3e:58:69:43, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-ff2b33e0-1618-4d31-8015-0f47137ecf03 req-efd1d22f-469a-473e-b24c-d499099d7a4b service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-unplugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff2b33e0-1618-4d31-8015-0f47137ecf03 req-efd1d22f-469a-473e-b24c-d499099d7a4b service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff2b33e0-1618-4d31-8015-0f47137ecf03 req-efd1d22f-469a-473e-b24c-d499099d7a4b service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff2b33e0-1618-4d31-8015-0f47137ecf03 req-efd1d22f-469a-473e-b24c-d499099d7a4b service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-ff2b33e0-1618-4d31-8015-0f47137ecf03 req-efd1d22f-469a-473e-b24c-d499099d7a4b service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-unplugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:37 user nova-compute[73067]: WARNING nova.compute.manager [req-ff2b33e0-1618-4d31-8015-0f47137ecf03 req-efd1d22f-469a-473e-b24c-d499099d7a4b service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-unplugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de139f26-0681-490d-904b-0f36af13538b tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.118s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Instance destroyed successfully.
Aug 16 10:35:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:39 user nova-compute[73067]: INFO nova.compute.manager [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Rebuilding instance
Aug 16 10:35:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'trusted_certs' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'pci_requests' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:40 user nova-compute[73067]: WARNING nova.compute.manager [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-changed-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Refreshing instance network info cache due to event network-changed-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] Acquiring lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] Acquired lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.network.neutron [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Refreshing network info cache for port c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'pci_devices' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'resources' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'migration_context' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73067) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-f1229999-fcd2-4bc6-8648-7de3c350a768 req-6b1b006e-df3b-46e6-af8c-501aea3c826c service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-vif-unplugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f1229999-fcd2-4bc6-8648-7de3c350a768 req-6b1b006e-df3b-46e6-af8c-501aea3c826c service nova] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f1229999-fcd2-4bc6-8648-7de3c350a768 req-6b1b006e-df3b-46e6-af8c-501aea3c826c service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f1229999-fcd2-4bc6-8648-7de3c350a768 req-6b1b006e-df3b-46e6-af8c-501aea3c826c service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-f1229999-fcd2-4bc6-8648-7de3c350a768 req-6b1b006e-df3b-46e6-af8c-501aea3c826c service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] No waiting events found dispatching network-vif-unplugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:40 user nova-compute[73067]: WARNING nova.compute.manager [req-f1229999-fcd2-4bc6-8648-7de3c350a768 req-6b1b006e-df3b-46e6-af8c-501aea3c826c service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received unexpected event network-vif-unplugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 for instance with vm_state active and task_state rebuilding.
Aug 16 10:35:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:40 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Instance destroyed successfully.
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.network.neutron [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updated VIF entry in instance network info cache for port c50ee3f9-3e3b-4896-a303-bdbf8153b3a1. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:35:40 user nova-compute[73067]: DEBUG nova.network.neutron [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updating instance_info_cache with network_info: [{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] Releasing lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-changed-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Refreshing instance network info cache due to event network-changed-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] Acquiring lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] Acquired lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG nova.network.neutron [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Refreshing network info cache for port c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:35:41 user nova-compute[73067]: INFO nova.compute.manager [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Detaching volume ac2d0615-79f2-4f6d-9854-4857305ade6e
Aug 16 10:35:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:41 user nova-compute[73067]: INFO nova.virt.block_device [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Attempting to driver detach volume ac2d0615-79f2-4f6d-9854-4857305ade6e from mountpoint /dev/vdb
Aug 16 10:35:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Attempting to detach device vdb from instance ffe1f07d-0a48-431d-be98-7e78018faa10 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:35:41 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:35:41 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:35:41 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:35:41 user nova-compute[73067]:   <serial>ac2d0615-79f2-4f6d-9854-4857305ade6e</serial>
Aug 16 10:35:41 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:35:41 user nova-compute[73067]: </disk>
Aug 16 10:35:41 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:35:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully detached device vdb from instance ffe1f07d-0a48-431d-be98-7e78018faa10 from the persistent domain config.
Aug 16 10:35:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKBWkqOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:35:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbad294-24ed-47b8-84be-7dd6ae85f4a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94890de-14cf-4d52-a555-474c69ea7623]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:41 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:35:41 user nova-compute[73067]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:35:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:41 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:35:41 user nova-compute[73067]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:35:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642da0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b272aa-e0aa-4199-a060-52f9f59b2cd9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2635cd6-247e-450f-bffe-84a41389d313]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6600925b-c21d-482a-b158-9a41371569ed]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:35:41 user nova-compute[73067]: INFO nova.compute.claims [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Claim successful on node user
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[894d0e29-2d6e-47ef-aba6-736c3609139f]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb2581e-2213-488d-a3c9-bb692d66ad85]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67dbe49-a1a1-4a62-9e04-d39490d526fc]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260]
Aug 16 10:35:41 user nova-compute[73067]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260] successful.
Aug 16 10:35:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd3d2ce-15aa-4483-bb8f-4b1b84cc0723]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.840s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== disconnect_volume: return (842ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:35:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for 6956e66e-229d-4f95-9d0b-d1e8c89a5360 due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182142.0215304, 6956e66e-229d-4f95-9d0b-d1e8c89a5360 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:35:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] VM Resumed (Lifecycle Event)
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ad908c14-c096-4b2a-b0be-9c0366f7ed08 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:42 user nova-compute[73067]: WARNING nova.compute.manager [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:42 user nova-compute[73067]: WARNING nova.compute.manager [req-de271de4-fee1-4f53-870d-b8597216e4ea req-285fcf45-2ef3-441c-a60b-35a2cd1b43f0 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:35:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182142.0261695, 6956e66e-229d-4f95-9d0b-d1e8c89a5360 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:35:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] VM Started (Lifecycle Event)
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.network.neutron [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updated VIF entry in instance network info cache for port c50ee3f9-3e3b-4896-a303-bdbf8153b3a1. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.network.neutron [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updating instance_info_cache with network_info: [{"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c3797437-65a3-488d-a4c9-06a1ed7377f4 req-c4ecca75-01d9-4af9-b1ca-ab4f023a6a46 service nova] Releasing lock "refresh_cache-6956e66e-229d-4f95-9d0b-d1e8c89a5360" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.network.neutron [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:35:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.policy [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcce750fe55c44809a3c42265e64f54c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1171c517852847f5a1de1e6236fa753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-a35330d3-5df9-410a-9237-4c4fc371a369 req-59d0e427-f4dd-4107-8a21-941a83baccc1 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a35330d3-5df9-410a-9237-4c4fc371a369 req-59d0e427-f4dd-4107-8a21-941a83baccc1 service nova] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a35330d3-5df9-410a-9237-4c4fc371a369 req-59d0e427-f4dd-4107-8a21-941a83baccc1 service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a35330d3-5df9-410a-9237-4c4fc371a369 req-59d0e427-f4dd-4107-8a21-941a83baccc1 service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-a35330d3-5df9-410a-9237-4c4fc371a369 req-59d0e427-f4dd-4107-8a21-941a83baccc1 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] No waiting events found dispatching network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:42 user nova-compute[73067]: WARNING nova.compute.manager [req-a35330d3-5df9-410a-9237-4c4fc371a369 req-59d0e427-f4dd-4107-8a21-941a83baccc1 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received unexpected event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 for instance with vm_state active and task_state rebuilding.
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:35:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Creating image(s)
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "/opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "/opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Instance destroyed successfully.
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-474030065',display_name='tempest-ServerActionsTestOtherA-server-900219677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-474030065',id=16,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSwseBSIzKQEmuDvq8Hdi2xgXNDpzTwGm6gMW/fO7+s7B2Iv2Dv1yoN6p8FMkcmuvxctndByirO8QFQRXIfhiELJwq44/dD13T3UEuod/ThSU86msaJkBUM3PERa3slQQ==',key_name='tempest-keypair-433429582',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-4xf1pl3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=ffe1f07d-0a48-431d-be98-7e78018faa10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_vif [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4af474f-c8, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:35:42 user nova-compute[73067]: INFO os_vif [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8')
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKBWkqOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:35:42 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b3fb16-1851-49b9-a9cf-2726325c8c73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[46322d9e-77a1-4e8f-9224-cf19342743de]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:42 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:35:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:42 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:35:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3584294c10>, {}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Disconnecting from: [] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== disconnect_volume: return (54ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:35:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Deleting instance files /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10_del
Aug 16 10:35:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Deletion of /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10_del complete
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.208s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:43 user nova-compute[73067]: INFO nova.virt.block_device [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Booting with volume ac2d0615-79f2-4f6d-9854-4857305ade6e at /dev/vdb
Aug 16 10:35:43 user nova-compute[73067]: DEBUG os_brick.utils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5355bb-69a0-40aa-a0fe-fa3ff1a2c3ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a556347f-7300-4457-a6df-ec022b7a3aed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk 1073741824" returned: 0 in 0.048s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b4ee70-71b9-446d-8014-ccfd1c703ad6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de60ddd-37d0-4a0a-9a78-102c845da374]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:35:43 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0b162d-37f1-422f-8dc0-ffef3ba6c073]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG os_brick.utils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Updating existing volume attachment record: 3bcc4f14-125e-47b1-976c-a7cce8fed100 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Successfully created port: 0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.224s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Cannot resize image /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'migration_context' on Instance uuid bc035e99-1a53-43df-8946-9c86ce2ecb0b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Ensure instance console log exists: /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Successfully updated port: 0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "refresh_cache-bc035e99-1a53-43df-8946-9c86ce2ecb0b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquired lock "refresh_cache-bc035e99-1a53-43df-8946-9c86ce2ecb0b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-20e0b3e1-8b20-4584-ba4f-208ab1523c09 req-e1084448-fc7a-4d4f-b2d9-7ddef5db2baa service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received event network-changed-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-20e0b3e1-8b20-4584-ba4f-208ab1523c09 req-e1084448-fc7a-4d4f-b2d9-7ddef5db2baa service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Refreshing instance network info cache due to event network-changed-0e377513-686a-458a-b39d-95cd3b041864. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-20e0b3e1-8b20-4584-ba4f-208ab1523c09 req-e1084448-fc7a-4d4f-b2d9-7ddef5db2baa service nova] Acquiring lock "refresh_cache-bc035e99-1a53-43df-8946-9c86ce2ecb0b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Updating instance_info_cache with network_info: [{"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Releasing lock "refresh_cache-bc035e99-1a53-43df-8946-9c86ce2ecb0b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Instance network_info: |[{"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-20e0b3e1-8b20-4584-ba4f-208ab1523c09 req-e1084448-fc7a-4d4f-b2d9-7ddef5db2baa service nova] Acquired lock "refresh_cache-bc035e99-1a53-43df-8946-9c86ce2ecb0b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.network.neutron [req-20e0b3e1-8b20-4584-ba4f-208ab1523c09 req-e1084448-fc7a-4d4f-b2d9-7ddef5db2baa service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Refreshing network info cache for port 0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Start _get_guest_xml network_info=[{"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:35:44 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:35:44 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-334963053',display_name='tempest-VolumesSnapshotTestJSON-instance-334963053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-334963053',id=22,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/CVWEpckZf/90salQQ6NE4POH/vzQPeoLKmvErfbzvmunuVVuekYoHfIIk23XWCMp0NtheoLz/IvmZXkgCEgPobwZf7TDWN28xapH959GCzYLilR/D84nlvBhJDqawCA==',key_name='tempest-keypair-357664148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1171c517852847f5a1de1e6236fa753e',ramdisk_id='',reservation_id='r-55l2j93r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-78639816',owner_user_name='tempest-VolumesSnapshotTestJSON-78639816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcce750fe55c44809a3c42265e64f54c',uuid=bc035e99-1a53-43df-8946-9c86ce2ecb0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converting VIF {"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ad:bb,bridge_name='br-int',has_traffic_filtering=True,id=0e377513-686a-458a-b39d-95cd3b041864,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e377513-68') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.objects.instance [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'pci_devices' on Instance uuid bc035e99-1a53-43df-8946-9c86ce2ecb0b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:35:44 user nova-compute[73067]:   <uuid>bc035e99-1a53-43df-8946-9c86ce2ecb0b</uuid>
Aug 16 10:35:44 user nova-compute[73067]:   <name>instance-00000016</name>
Aug 16 10:35:44 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:35:44 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:35:44 user nova-compute[73067]:   <metadata>
Aug 16 10:35:44 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:35:44 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:35:44 user nova-compute[73067]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-334963053</nova:name>
Aug 16 10:35:44 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:35:44</nova:creationTime>
Aug 16 10:35:44 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:35:44 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:35:44 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:35:44 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:35:44 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:35:44 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:35:44 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:35:44 user nova-compute[73067]:       <nova:owner>
Aug 16 10:35:44 user nova-compute[73067]:         <nova:user uuid="dcce750fe55c44809a3c42265e64f54c">tempest-VolumesSnapshotTestJSON-78639816-project-member</nova:user>
Aug 16 10:35:44 user nova-compute[73067]:         <nova:project uuid="1171c517852847f5a1de1e6236fa753e">tempest-VolumesSnapshotTestJSON-78639816</nova:project>
Aug 16 10:35:44 user nova-compute[73067]:       </nova:owner>
Aug 16 10:35:44 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:35:44 user nova-compute[73067]:       <nova:ports>
Aug 16 10:35:44 user nova-compute[73067]:         <nova:port uuid="0e377513-686a-458a-b39d-95cd3b041864">
Aug 16 10:35:44 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 10:35:44 user nova-compute[73067]:         </nova:port>
Aug 16 10:35:44 user nova-compute[73067]:       </nova:ports>
Aug 16 10:35:44 user nova-compute[73067]:     </nova:instance>
Aug 16 10:35:44 user nova-compute[73067]:   </metadata>
Aug 16 10:35:44 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:35:44 user nova-compute[73067]:     <system>
Aug 16 10:35:44 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:35:44 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:35:44 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:35:44 user nova-compute[73067]:       <entry name="serial">bc035e99-1a53-43df-8946-9c86ce2ecb0b</entry>
Aug 16 10:35:44 user nova-compute[73067]:       <entry name="uuid">bc035e99-1a53-43df-8946-9c86ce2ecb0b</entry>
Aug 16 10:35:44 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:35:44 user nova-compute[73067]:     </system>
Aug 16 10:35:44 user nova-compute[73067]:   </sysinfo>
Aug 16 10:35:44 user nova-compute[73067]:   <os>
Aug 16 10:35:44 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:35:44 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:35:44 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:35:44 user nova-compute[73067]:   </os>
Aug 16 10:35:44 user nova-compute[73067]:   <features>
Aug 16 10:35:44 user nova-compute[73067]:     <acpi/>
Aug 16 10:35:44 user nova-compute[73067]:     <apic/>
Aug 16 10:35:44 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:35:44 user nova-compute[73067]:   </features>
Aug 16 10:35:44 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:35:44 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:35:44 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:35:44 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:35:44 user nova-compute[73067]:   </clock>
Aug 16 10:35:44 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:35:44 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:35:44 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:35:44 user nova-compute[73067]:   </cpu>
Aug 16 10:35:44 user nova-compute[73067]:   <devices>
Aug 16 10:35:44 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:35:44 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:35:44 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk"/>
Aug 16 10:35:44 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:35:44 user nova-compute[73067]:     </disk>
Aug 16 10:35:44 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:35:44 user nova-compute[73067]:       <mac address="fa:16:3e:b7:ad:bb"/>
Aug 16 10:35:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:35:44 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:35:44 user nova-compute[73067]:       <target dev="tap0e377513-68"/>
Aug 16 10:35:44 user nova-compute[73067]:     </interface>
Aug 16 10:35:44 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:35:44 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/console.log" append="off"/>
Aug 16 10:35:44 user nova-compute[73067]:     </serial>
Aug 16 10:35:44 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:35:44 user nova-compute[73067]:     <video>
Aug 16 10:35:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:35:44 user nova-compute[73067]:     </video>
Aug 16 10:35:44 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:35:44 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:35:44 user nova-compute[73067]:     </rng>
Aug 16 10:35:44 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:35:44 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:35:44 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:35:44 user nova-compute[73067]:     </memballoon>
Aug 16 10:35:44 user nova-compute[73067]:   </devices>
Aug 16 10:35:44 user nova-compute[73067]: </domain>
Aug 16 10:35:44 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-334963053',display_name='tempest-VolumesSnapshotTestJSON-instance-334963053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-334963053',id=22,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/CVWEpckZf/90salQQ6NE4POH/vzQPeoLKmvErfbzvmunuVVuekYoHfIIk23XWCMp0NtheoLz/IvmZXkgCEgPobwZf7TDWN28xapH959GCzYLilR/D84nlvBhJDqawCA==',key_name='tempest-keypair-357664148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1171c517852847f5a1de1e6236fa753e',ramdisk_id='',reservation_id='r-55l2j93r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-78639816',owner_user_name='tempest-VolumesSnapshotTestJSON-78639816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcce750fe55c44809a3c42265e64f54c',uuid=bc035e99-1a53-43df-8946-9c86ce2ecb0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converting VIF {"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ad:bb,bridge_name='br-int',has_traffic_filtering=True,id=0e377513-686a-458a-b39d-95cd3b041864,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e377513-68') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG os_vif [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ad:bb,bridge_name='br-int',has_traffic_filtering=True,id=0e377513-686a-458a-b39d-95cd3b041864,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e377513-68') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e377513-68, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e377513-68, col_values=(('external_ids', {'iface-id': '0e377513-686a-458a-b39d-95cd3b041864', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:ad:bb', 'vm-uuid': 'bc035e99-1a53-43df-8946-9c86ce2ecb0b'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:44 user nova-compute[73067]: INFO os_vif [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ad:bb,bridge_name='br-int',has_traffic_filtering=True,id=0e377513-686a-458a-b39d-95cd3b041864,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e377513-68')
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:35:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] No VIF found with MAC fa:16:3e:b7:ad:bb, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:35:45 user nova-compute[73067]: DEBUG nova.network.neutron [req-20e0b3e1-8b20-4584-ba4f-208ab1523c09 req-e1084448-fc7a-4d4f-b2d9-7ddef5db2baa service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Updated VIF entry in instance network info cache for port 0e377513-686a-458a-b39d-95cd3b041864. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:35:45 user nova-compute[73067]: DEBUG nova.network.neutron [req-20e0b3e1-8b20-4584-ba4f-208ab1523c09 req-e1084448-fc7a-4d4f-b2d9-7ddef5db2baa service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Updating instance_info_cache with network_info: [{"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-20e0b3e1-8b20-4584-ba4f-208ab1523c09 req-e1084448-fc7a-4d4f-b2d9-7ddef5db2baa service nova] Releasing lock "refresh_cache-bc035e99-1a53-43df-8946-9c86ce2ecb0b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:35:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-93d12650-a89f-41d1-a13e-eafa3378b94a req-779b2287-9e9c-4136-9748-48753b8f7938 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-changed-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-93d12650-a89f-41d1-a13e-eafa3378b94a req-779b2287-9e9c-4136-9748-48753b8f7938 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Refreshing instance network info cache due to event network-changed-2a42b863-50bb-4a5e-acbe-69b57ef321d0. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-93d12650-a89f-41d1-a13e-eafa3378b94a req-779b2287-9e9c-4136-9748-48753b8f7938 service nova] Acquiring lock "refresh_cache-6a791852-6268-4679-8b8f-e86eac3d5ad4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-93d12650-a89f-41d1-a13e-eafa3378b94a req-779b2287-9e9c-4136-9748-48753b8f7938 service nova] Acquired lock "refresh_cache-6a791852-6268-4679-8b8f-e86eac3d5ad4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:35:46 user nova-compute[73067]: DEBUG nova.network.neutron [req-93d12650-a89f-41d1-a13e-eafa3378b94a req-779b2287-9e9c-4136-9748-48753b8f7938 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Refreshing network info cache for port 2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:35:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-3ec36ffa-4857-43c3-955a-657b384cbc6f req-df63aafa-a7db-4e9f-a18c-d0962a58971a service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received event network-vif-plugged-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3ec36ffa-4857-43c3-955a-657b384cbc6f req-df63aafa-a7db-4e9f-a18c-d0962a58971a service nova] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3ec36ffa-4857-43c3-955a-657b384cbc6f req-df63aafa-a7db-4e9f-a18c-d0962a58971a service nova] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3ec36ffa-4857-43c3-955a-657b384cbc6f req-df63aafa-a7db-4e9f-a18c-d0962a58971a service nova] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-3ec36ffa-4857-43c3-955a-657b384cbc6f req-df63aafa-a7db-4e9f-a18c-d0962a58971a service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] No waiting events found dispatching network-vif-plugged-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:47 user nova-compute[73067]: WARNING nova.compute.manager [req-3ec36ffa-4857-43c3-955a-657b384cbc6f req-df63aafa-a7db-4e9f-a18c-d0962a58971a service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received unexpected event network-vif-plugged-0e377513-686a-458a-b39d-95cd3b041864 for instance with vm_state building and task_state spawning.
Aug 16 10:35:47 user nova-compute[73067]: INFO nova.compute.manager [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Rebuilding instance
Aug 16 10:35:47 user nova-compute[73067]: DEBUG nova.network.neutron [req-93d12650-a89f-41d1-a13e-eafa3378b94a req-779b2287-9e9c-4136-9748-48753b8f7938 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Updated VIF entry in instance network info cache for port 2a42b863-50bb-4a5e-acbe-69b57ef321d0. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG nova.network.neutron [req-93d12650-a89f-41d1-a13e-eafa3378b94a req-779b2287-9e9c-4136-9748-48753b8f7938 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Updating instance_info_cache with network_info: [{"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:35:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-93d12650-a89f-41d1-a13e-eafa3378b94a req-779b2287-9e9c-4136-9748-48753b8f7938 service nova] Releasing lock "refresh_cache-6a791852-6268-4679-8b8f-e86eac3d5ad4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a791852-6268-4679-8b8f-e86eac3d5ad4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lazy-loading 'pci_requests' on Instance uuid 6a791852-6268-4679-8b8f-e86eac3d5ad4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a791852-6268-4679-8b8f-e86eac3d5ad4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lazy-loading 'resources' on Instance uuid 6a791852-6268-4679-8b8f-e86eac3d5ad4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lazy-loading 'migration_context' on Instance uuid 6a791852-6268-4679-8b8f-e86eac3d5ad4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73067) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-498ab651-c08f-41d2-ada9-c006d378d7cc req-0da4539b-3729-4c26-97d9-7af4248494c6 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-vif-unplugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-498ab651-c08f-41d2-ada9-c006d378d7cc req-0da4539b-3729-4c26-97d9-7af4248494c6 service nova] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-498ab651-c08f-41d2-ada9-c006d378d7cc req-0da4539b-3729-4c26-97d9-7af4248494c6 service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-498ab651-c08f-41d2-ada9-c006d378d7cc req-0da4539b-3729-4c26-97d9-7af4248494c6 service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-498ab651-c08f-41d2-ada9-c006d378d7cc req-0da4539b-3729-4c26-97d9-7af4248494c6 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] No waiting events found dispatching network-vif-unplugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:48 user nova-compute[73067]: WARNING nova.compute.manager [req-498ab651-c08f-41d2-ada9-c006d378d7cc req-0da4539b-3729-4c26-97d9-7af4248494c6 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received unexpected event network-vif-unplugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 for instance with vm_state active and task_state rebuilding.
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Instance destroyed successfully.
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Instance destroyed successfully.
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1260743046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1270920761',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh0HAwQTZopjSQvK4nRNzkmupgLc79gEeAnD6JiXUo09M1Aow2M59+WM4PCI/pkDjFgU58/V8/dsPWTgCy06otTlpj2gcZiXpmpK3PlioaPiBZfU7RdCLMYdPEz4NhR+Q==',key_name='tempest-keypair-263281918',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:34:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ab3b5056f7f40b79a779c06def8f966',ramdisk_id='',reservation_id='r-eijqx0a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-327151388',owner_user_name='tempest-ServerActionsV293TestJSON-327151388-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:35:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a82f0b5e6de4d459a9f474ca9eef0a3',uuid=6a791852-6268-4679-8b8f-e86eac3d5ad4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converting VIF {"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_vif [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a42b863-50, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:49 user nova-compute[73067]: INFO os_vif [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50')
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNflELXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:35:49 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68e9304-65db-49a8-a2b7-2926f609bff6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0f3065-affa-4718-86b9-312ffa3b93ef]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:49 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:35:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:49 user nova-compute[73067]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:35:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3593783a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce45e8d7-32d6-41d0-84c4-7bf33f93b02d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df8c162-8e26-4c97-8098-c876eebc5f18]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[73386ea8-80a1-4adc-bbe3-e690662504ae]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0c7806-b674-4bc4-bc48-96e25bc14287]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26465393531346438', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_aae1a775', '/dev/disk/by-id/scsi-1SCST_BIOaae1a775-de9514d8ea8a1d28') {{(pid=84181) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcfc528-318a-494c-b625-c9a122fa9c80]: (4, None) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d91f55-1d32-4b25-a0c0-99b68e8c789f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182149.5160224, bc035e99-1a53-43df-8946-9c86ce2ecb0b => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] VM Resumed (Lifecycle Event)
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Instance spawned successfully.
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --logout" returned: 0 in 0.158s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[037508fd-2143-4a7e-aa1b-b7ead7c69a9f]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260]
Aug 16 10:35:49 user nova-compute[73067]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260] successful.
Aug 16 10:35:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c417edcf-dd43-42bd-9dd5-3e0a50c4dc8f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] <== disconnect_volume: return (457ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Deleting instance files /opt/stack/data/nova/instances/6a791852-6268-4679-8b8f-e86eac3d5ad4_del
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Deletion of /opt/stack/data/nova/instances/6a791852-6268-4679-8b8f-e86eac3d5ad4_del complete
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182149.5173216, bc035e99-1a53-43df-8946-9c86ce2ecb0b => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] VM Started (Lifecycle Event)
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.compute.manager [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Took 6.99 seconds to spawn the instance on the hypervisor.
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-34bf7f89-364f-47c8-939b-72a739e4df5d req-641ca9ce-9c5b-4376-a2dd-5c500221706a service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received event network-vif-plugged-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-34bf7f89-364f-47c8-939b-72a739e4df5d req-641ca9ce-9c5b-4376-a2dd-5c500221706a service nova] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-34bf7f89-364f-47c8-939b-72a739e4df5d req-641ca9ce-9c5b-4376-a2dd-5c500221706a service nova] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-34bf7f89-364f-47c8-939b-72a739e4df5d req-641ca9ce-9c5b-4376-a2dd-5c500221706a service nova] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-34bf7f89-364f-47c8-939b-72a739e4df5d req-641ca9ce-9c5b-4376-a2dd-5c500221706a service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] No waiting events found dispatching network-vif-plugged-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:49 user nova-compute[73067]: WARNING nova.compute.manager [req-34bf7f89-364f-47c8-939b-72a739e4df5d req-641ca9ce-9c5b-4376-a2dd-5c500221706a service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received unexpected event network-vif-plugged-0e377513-686a-458a-b39d-95cd3b041864 for instance with vm_state building and task_state spawning.
Aug 16 10:35:49 user nova-compute[73067]: INFO nova.compute.manager [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Took 8.08 seconds to build instance.
Aug 16 10:35:49 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 6a791852-6268-4679-8b8f-e86eac3d5ad4 could not be found.
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-120eee76-cf53-41ea-9b03-f343439ac076 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.170s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNflELXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:35:49 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e48f123-b059-4928-9510-cd77fa7fc042]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5e3ed0-d0a4-433c-bdad-8add6cc63a01]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642b7250>, {}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Disconnecting from: [] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] <== disconnect_volume: return (55ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:35:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:35:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-e53465a5-5204-48ff-a1d2-219732768fe6 req-50811ff6-bd87-455d-9252-b5d193e2ffff service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e53465a5-5204-48ff-a1d2-219732768fe6 req-50811ff6-bd87-455d-9252-b5d193e2ffff service nova] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e53465a5-5204-48ff-a1d2-219732768fe6 req-50811ff6-bd87-455d-9252-b5d193e2ffff service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e53465a5-5204-48ff-a1d2-219732768fe6 req-50811ff6-bd87-455d-9252-b5d193e2ffff service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-e53465a5-5204-48ff-a1d2-219732768fe6 req-50811ff6-bd87-455d-9252-b5d193e2ffff service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] No waiting events found dispatching network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:50 user nova-compute[73067]: WARNING nova.compute.manager [req-e53465a5-5204-48ff-a1d2-219732768fe6 req-50811ff6-bd87-455d-9252-b5d193e2ffff service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received unexpected event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 for instance with vm_state active and task_state rebuilding.
Aug 16 10:35:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:35:54 user nova-compute[73067]: WARNING nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid b51879a0-d5a1-4f96-b0c1-0672d31e80db {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 311f3d35-c279-4b63-b3e1-7528c30ac659 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid cca10fa3-1289-4ee9-b1d8-fe37afc92960 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 6a791852-6268-4679-8b8f-e86eac3d5ad4 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 2448aa3f-a0a6-43c6-8844-dbfb8145d779 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid fcb6379a-4c57-462b-a4ea-9680340a5137 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 0f85b78e-78c3-4e5a-a33d-ace04474a737 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid bc035e99-1a53-43df-8946-9c86ce2ecb0b {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "311f3d35-c279-4b63-b3e1-7528c30ac659" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: INFO nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: INFO nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] During sync_power_state the instance has a pending task (rebuilding). Skip.
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:35:55 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Creating image(s)
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "/opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "/opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG nova.compute.manager [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Preparing to wait for external event volume-reimaged-999ca751-8c68-4f24-b23a-8b5d0dca292b {{(pid=73067) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182140.8562365, ffe1f07d-0a48-431d-be98-7e78018faa10 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:35:55 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] VM Stopped (Lifecycle Event)
Aug 16 10:35:55 user nova-compute[73067]: DEBUG nova.compute.manager [None req-bc0462f9-82ab-450f-907d-5b9ea6766dc2 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk 1073741824" returned: 0 in 0.062s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Cannot resize image /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Ensure instance console log exists: /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Start _get_guest_xml network_info=[{"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKBWkqOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ffe1f07d-0a48-431d-be98-7e78018faa10', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac2d0615-79f2-4f6d-9854-4857305ade6e', 'serial': 'ac2d0615-79f2-4f6d-9854-4857305ade6e'}, 'delete_on_termination': False, 'attachment_id': '3bcc4f14-125e-47b1-976c-a7cce8fed100', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:35:56 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 10:35:56 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'vcpu_model' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKBWkqOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:35:56 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:35:56 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:35:56 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f04a61-308f-4326-9e32-c1848bf337d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:35:56 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79701a5-8ed6-48f7-a5ab-a7c6e0349bdd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e] added
Aug 16 10:35:56 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3fe45d-640f-43c9-9c23-ff54c21a92fb]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[644599ee-5a6c-436a-bd4b-34c36000b593]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vKBWkqOC {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vKBWkqOC" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4b69fe-5cc8-45ea-9b2d-af945288fa2a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vKBWkqOC'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8f29ea-3e31-4040-82b4-98e2bf659768]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[25859267-537d-4451-a244-a8a45a106541]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:56 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:56 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f0a18-2fc3-4c7a-a8b6-0ff3d9542a7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260]
Aug 16 10:35:56 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260] successful.
Aug 16 10:35:56 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb462bad-46f7-4a8f-bc7d-a0decccc8cf7]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[168e4229-9a63-4ec0-b10d-304593f3826a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:56 user nova-compute[73067]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:35:56 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:35:56 user nova-compute[73067]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:35:56 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[921d624f-19f1-452c-8b51-cedec188d5ff]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:35:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKBWkqOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26437636439643565', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437636439643565', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-474030065',display_name='tempest-ServerActionsTestOtherA-server-900219677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-474030065',id=16,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSwseBSIzKQEmuDvq8Hdi2xgXNDpzTwGm6gMW/fO7+s7B2Iv2Dv1yoN6p8FMkcmuvxctndByirO8QFQRXIfhiELJwq44/dD13T3UEuod/ThSU86msaJkBUM3PERa3slQQ==',key_name='tempest-keypair-433429582',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-4xf1pl3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=ffe1f07d-0a48-431d-be98-7e78018faa10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:35:57 user nova-compute[73067]:   <uuid>ffe1f07d-0a48-431d-be98-7e78018faa10</uuid>
Aug 16 10:35:57 user nova-compute[73067]:   <name>instance-00000010</name>
Aug 16 10:35:57 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:35:57 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:35:57 user nova-compute[73067]:   <metadata>
Aug 16 10:35:57 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:35:57 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:35:57 user nova-compute[73067]:       <nova:name>tempest-ServerActionsTestOtherA-server-900219677</nova:name>
Aug 16 10:35:57 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:35:56</nova:creationTime>
Aug 16 10:35:57 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:35:57 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:35:57 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:35:57 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:35:57 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:35:57 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:35:57 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:35:57 user nova-compute[73067]:       <nova:owner>
Aug 16 10:35:57 user nova-compute[73067]:         <nova:user uuid="9e4cbf9cec1c4c438adbbab6bd7f794c">tempest-ServerActionsTestOtherA-1833692287-project-member</nova:user>
Aug 16 10:35:57 user nova-compute[73067]:         <nova:project uuid="1b7b37f1cdfe41ddb6545c23a5b5c8b4">tempest-ServerActionsTestOtherA-1833692287</nova:project>
Aug 16 10:35:57 user nova-compute[73067]:       </nova:owner>
Aug 16 10:35:57 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:35:57 user nova-compute[73067]:       <nova:ports>
Aug 16 10:35:57 user nova-compute[73067]:         <nova:port uuid="f4af474f-c83b-403b-abed-abaf9c0e71f8">
Aug 16 10:35:57 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 10:35:57 user nova-compute[73067]:         </nova:port>
Aug 16 10:35:57 user nova-compute[73067]:       </nova:ports>
Aug 16 10:35:57 user nova-compute[73067]:     </nova:instance>
Aug 16 10:35:57 user nova-compute[73067]:   </metadata>
Aug 16 10:35:57 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:35:57 user nova-compute[73067]:     <system>
Aug 16 10:35:57 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:35:57 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:35:57 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:35:57 user nova-compute[73067]:       <entry name="serial">ffe1f07d-0a48-431d-be98-7e78018faa10</entry>
Aug 16 10:35:57 user nova-compute[73067]:       <entry name="uuid">ffe1f07d-0a48-431d-be98-7e78018faa10</entry>
Aug 16 10:35:57 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:35:57 user nova-compute[73067]:     </system>
Aug 16 10:35:57 user nova-compute[73067]:   </sysinfo>
Aug 16 10:35:57 user nova-compute[73067]:   <os>
Aug 16 10:35:57 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:35:57 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:35:57 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:35:57 user nova-compute[73067]:   </os>
Aug 16 10:35:57 user nova-compute[73067]:   <features>
Aug 16 10:35:57 user nova-compute[73067]:     <acpi/>
Aug 16 10:35:57 user nova-compute[73067]:     <apic/>
Aug 16 10:35:57 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:35:57 user nova-compute[73067]:   </features>
Aug 16 10:35:57 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:35:57 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:35:57 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:35:57 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:35:57 user nova-compute[73067]:   </clock>
Aug 16 10:35:57 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:35:57 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:35:57 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:35:57 user nova-compute[73067]:   </cpu>
Aug 16 10:35:57 user nova-compute[73067]:   <devices>
Aug 16 10:35:57 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:35:57 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:35:57 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk"/>
Aug 16 10:35:57 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:35:57 user nova-compute[73067]:     </disk>
Aug 16 10:35:57 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:35:57 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:35:57 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 10:35:57 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:35:57 user nova-compute[73067]:       <serial>ac2d0615-79f2-4f6d-9854-4857305ade6e</serial>
Aug 16 10:35:57 user nova-compute[73067]:     </disk>
Aug 16 10:35:57 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:35:57 user nova-compute[73067]:       <mac address="fa:16:3e:58:69:43"/>
Aug 16 10:35:57 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:35:57 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:35:57 user nova-compute[73067]:       <target dev="tapf4af474f-c8"/>
Aug 16 10:35:57 user nova-compute[73067]:     </interface>
Aug 16 10:35:57 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:35:57 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/console.log" append="off"/>
Aug 16 10:35:57 user nova-compute[73067]:     </serial>
Aug 16 10:35:57 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:35:57 user nova-compute[73067]:     <video>
Aug 16 10:35:57 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:35:57 user nova-compute[73067]:     </video>
Aug 16 10:35:57 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:35:57 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:35:57 user nova-compute[73067]:     </rng>
Aug 16 10:35:57 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:35:57 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:35:57 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:35:57 user nova-compute[73067]:     </memballoon>
Aug 16 10:35:57 user nova-compute[73067]:   </devices>
Aug 16 10:35:57 user nova-compute[73067]: </domain>
Aug 16 10:35:57 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-474030065',display_name='tempest-ServerActionsTestOtherA-server-900219677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-474030065',id=16,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSwseBSIzKQEmuDvq8Hdi2xgXNDpzTwGm6gMW/fO7+s7B2Iv2Dv1yoN6p8FMkcmuvxctndByirO8QFQRXIfhiELJwq44/dD13T3UEuod/ThSU86msaJkBUM3PERa3slQQ==',key_name='tempest-keypair-433429582',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-4xf1pl3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=ffe1f07d-0a48-431d-be98-7e78018faa10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG os_vif [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4af474f-c8, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4af474f-c8, col_values=(('external_ids', {'iface-id': 'f4af474f-c83b-403b-abed-abaf9c0e71f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:69:43', 'vm-uuid': 'ffe1f07d-0a48-431d-be98-7e78018faa10'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:35:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:57 user nova-compute[73067]: INFO os_vif [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8')
Aug 16 10:35:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:35:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:35:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No VIF found with MAC fa:16:3e:58:69:43, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:35:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:35:59 user nova-compute[73067]: DEBUG nova.compute.manager [req-af45ef76-b5a8-49e1-b692-e0a435940726 req-db2cedbb-4121-4e9d-b0ae-786a3f6a3a2d service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:35:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-af45ef76-b5a8-49e1-b692-e0a435940726 req-db2cedbb-4121-4e9d-b0ae-786a3f6a3a2d service nova] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:35:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-af45ef76-b5a8-49e1-b692-e0a435940726 req-db2cedbb-4121-4e9d-b0ae-786a3f6a3a2d service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:35:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-af45ef76-b5a8-49e1-b692-e0a435940726 req-db2cedbb-4121-4e9d-b0ae-786a3f6a3a2d service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:35:59 user nova-compute[73067]: DEBUG nova.compute.manager [req-af45ef76-b5a8-49e1-b692-e0a435940726 req-db2cedbb-4121-4e9d-b0ae-786a3f6a3a2d service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] No waiting events found dispatching network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:35:59 user nova-compute[73067]: WARNING nova.compute.manager [req-af45ef76-b5a8-49e1-b692-e0a435940726 req-db2cedbb-4121-4e9d-b0ae-786a3f6a3a2d service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received unexpected event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 10:36:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182161.5565867, ffe1f07d-0a48-431d-be98-7e78018faa10 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:36:01 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] VM Resumed (Lifecycle Event)
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:36:01 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Instance spawned successfully.
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:01 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182161.5590796, ffe1f07d-0a48-431d-be98-7e78018faa10 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:36:01 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] VM Started (Lifecycle Event)
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-bf38a1f4-167b-4647-9bdb-55e120aa6b40 req-f8de9ffa-345f-4aa8-8f0e-6fb9419b7703 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bf38a1f4-167b-4647-9bdb-55e120aa6b40 req-f8de9ffa-345f-4aa8-8f0e-6fb9419b7703 service nova] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bf38a1f4-167b-4647-9bdb-55e120aa6b40 req-f8de9ffa-345f-4aa8-8f0e-6fb9419b7703 service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bf38a1f4-167b-4647-9bdb-55e120aa6b40 req-f8de9ffa-345f-4aa8-8f0e-6fb9419b7703 service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-bf38a1f4-167b-4647-9bdb-55e120aa6b40 req-f8de9ffa-345f-4aa8-8f0e-6fb9419b7703 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] No waiting events found dispatching network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:36:01 user nova-compute[73067]: WARNING nova.compute.manager [req-bf38a1f4-167b-4647-9bdb-55e120aa6b40 req-f8de9ffa-345f-4aa8-8f0e-6fb9419b7703 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received unexpected event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:36:01 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 10:36:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73067) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 10:36:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f09cff5f-bb81-4f12-81b4-bbd570cec102 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.105s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:04 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182149.0243552, 6a791852-6268-4679-8b8f-e86eac3d5ad4 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:36:04 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] VM Stopped (Lifecycle Event)
Aug 16 10:36:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c18f8d7d-06f6-4d2b-aca2-1af82a7195bf None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:36:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:11 user nova-compute[73067]: INFO nova.compute.manager [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Detaching volume 8b6534b8-33c4-4781-9a17-ead5b83f893b
Aug 16 10:36:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:11 user nova-compute[73067]: INFO nova.virt.block_device [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Attempting to driver detach volume 8b6534b8-33c4-4781-9a17-ead5b83f893b from mountpoint /dev/vdb
Aug 16 10:36:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Attempting to detach device vdb from instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:36:11 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:36:11 user nova-compute[73067]:   <source dev="/dev/sdf"/>
Aug 16 10:36:11 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:36:11 user nova-compute[73067]:   <serial>8b6534b8-33c4-4781-9a17-ead5b83f893b</serial>
Aug 16 10:36:11 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:36:11 user nova-compute[73067]: </disk>
Aug 16 10:36:11 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:36:11 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Successfully detached device vdb from instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 from the persistent domain config.
Aug 16 10:36:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:36:11 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:36:11 user nova-compute[73067]:   <source dev="/dev/sdf"/>
Aug 16 10:36:11 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:36:11 user nova-compute[73067]:   <serial>8b6534b8-33c4-4781-9a17-ead5b83f893b</serial>
Aug 16 10:36:11 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:36:11 user nova-compute[73067]: </disk>
Aug 16 10:36:11 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182171.7728002, 6956e66e-229d-4f95-9d0b-d1e8c89a5360 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:36:11 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Successfully detached device vdb from instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 from the live domain config.
Aug 16 10:36:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XfCSecdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:36:11 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:36:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1832da4b-5f10-4a43-820b-53b05003f88c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95601b05-a96f-4a6a-9324-baecf1f55cd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc024e1-ed4b-4b00-9a8b-7a2febd58fe1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95601b05-a96f-4a6a-9324-baecf1f55cd8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:36:11 user nova-compute[73067]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:11 user nova-compute[73067]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95601b05-a96f-4a6a-9324-baecf1f55cd8 (non-flash)
Aug 16 10:36:11 user nova-compute[73067]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b (non-flash)
Aug 16 10:36:11 user nova-compute[73067]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:11 user nova-compute[73067]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95601b05-a96f-4a6a-9324-baecf1f55cd8 (non-flash)
Aug 16 10:36:11 user nova-compute[73067]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642b5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b'): ({'sdf'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Removing single pathed devices sdf {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c36ecf-80a3-42d3-b160-856ce73b7810]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4f0391-e50d-4528-9877-4439ba18c9fb]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Flushing IO for device /dev/sdf {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f495e7-ad0b-4271-8739-178fb66a9588]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:36:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d6ac21-f233-478f-bf80-4ed3e6265b43]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] SCSI volumes sdf have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b59a6c2', '/dev/disk/by-id/scsi-1SCST_BIOb59a6c2-15bcbed846e2645f', '/dev/disk/by-id/scsi-23135626362656438') {{(pid=84181) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb75d88c-554b-469c-b0b1-1ff424bd06d4]: (4, None) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3fb952-2c47-4941-bbcb-53dd8606a8b8]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f1b91-ebee-471a-90f8-0cf693f71080]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b, portal: 172.16.0.220,3260]
Aug 16 10:36:12 user nova-compute[73067]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b, portal: 172.16.0.220,3260] successful.
Aug 16 10:36:12 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b6534b8-33c4-4781-9a17-ead5b83f893b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa52519-e742-4df6-bcae-3daa94e2e47f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] <== disconnect_volume: return (406ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:36:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:13 user nova-compute[73067]: DEBUG nova.objects.instance [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'flavor' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:36:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-de8e9944-fd97-406b-8ff9-568490e14570 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.949s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:15 user nova-compute[73067]: INFO nova.compute.manager [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Terminating instance
Aug 16 10:36:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:36:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9c45c1c-9d6d-46a8-b51b-5ffae9f4f96b req-1e88ed7a-d2ef-4ab4-af44-4ee77e993dfa service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received event network-vif-unplugged-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:36:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9c45c1c-9d6d-46a8-b51b-5ffae9f4f96b req-1e88ed7a-d2ef-4ab4-af44-4ee77e993dfa service nova] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9c45c1c-9d6d-46a8-b51b-5ffae9f4f96b req-1e88ed7a-d2ef-4ab4-af44-4ee77e993dfa service nova] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a9c45c1c-9d6d-46a8-b51b-5ffae9f4f96b req-1e88ed7a-d2ef-4ab4-af44-4ee77e993dfa service nova] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9c45c1c-9d6d-46a8-b51b-5ffae9f4f96b req-1e88ed7a-d2ef-4ab4-af44-4ee77e993dfa service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] No waiting events found dispatching network-vif-unplugged-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:36:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-a9c45c1c-9d6d-46a8-b51b-5ffae9f4f96b req-1e88ed7a-d2ef-4ab4-af44-4ee77e993dfa service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received event network-vif-unplugged-8775245b-73ca-43f0-b4cd-170134560df7 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:36:17 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Instance destroyed successfully.
Aug 16 10:36:17 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lazy-loading 'resources' on Instance uuid cca10fa3-1289-4ee9-b1d8-fe37afc92960 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:36:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1314418798',display_name='tempest-VolumesAdminNegativeTest-server-1314418798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1314418798',id=6,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyKi2smPOie1HRX/p6hS/Y6z904llmKey53nToTLsDJw2pdpik02tH5DT3sMW4lAiitRvvEefM2Yd21+khylfepRTr4NVFRn4RSKhwnj+tx7FtX/RIEUqQ4SzJg/KVpNQ==',key_name='tempest-keypair-505197428',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82e7f124a2a74ac482ff13de710ba04a',ramdisk_id='',reservation_id='r-c0yvwpik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1324591370',owner_user_name='tempest-VolumesAdminNegativeTest-1324591370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b63f9ed0b5294eaf8919cf4c9bcea4ea',uuid=cca10fa3-1289-4ee9-b1d8-fe37afc92960,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:36:17 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converting VIF {"id": "8775245b-73ca-43f0-b4cd-170134560df7", "address": "fa:16:3e:01:58:8c", "network": {"id": "bbcdf39b-641e-4669-a10d-b335ee278793", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1004370865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e7f124a2a74ac482ff13de710ba04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8775245b-73", "ovs_interfaceid": "8775245b-73ca-43f0-b4cd-170134560df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:36:17 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:58:8c,bridge_name='br-int',has_traffic_filtering=True,id=8775245b-73ca-43f0-b4cd-170134560df7,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8775245b-73') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:36:17 user nova-compute[73067]: DEBUG os_vif [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:58:8c,bridge_name='br-int',has_traffic_filtering=True,id=8775245b-73ca-43f0-b4cd-170134560df7,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8775245b-73') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:36:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8775245b-73, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:36:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:36:17 user nova-compute[73067]: INFO os_vif [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:58:8c,bridge_name='br-int',has_traffic_filtering=True,id=8775245b-73ca-43f0-b4cd-170134560df7,network=Network(bbcdf39b-641e-4669-a10d-b335ee278793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8775245b-73')
Aug 16 10:36:17 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Deleting instance files /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960_del
Aug 16 10:36:17 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Deletion of /opt/stack/data/nova/instances/cca10fa3-1289-4ee9-b1d8-fe37afc92960_del complete
Aug 16 10:36:17 user nova-compute[73067]: INFO nova.compute.manager [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Took 1.92 seconds to destroy the instance on the hypervisor.
Aug 16 10:36:17 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:36:17 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:36:17 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:36:18 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:36:18 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Took 1.11 seconds to deallocate network for instance.
Aug 16 10:36:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-adbd738c-4118-4089-9f9a-7ce739e83096 req-ca663c5c-7b5e-420d-8fef-5e470562fb34 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received event network-vif-plugged-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-adbd738c-4118-4089-9f9a-7ce739e83096 req-ca663c5c-7b5e-420d-8fef-5e470562fb34 service nova] Acquiring lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-adbd738c-4118-4089-9f9a-7ce739e83096 req-ca663c5c-7b5e-420d-8fef-5e470562fb34 service nova] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-adbd738c-4118-4089-9f9a-7ce739e83096 req-ca663c5c-7b5e-420d-8fef-5e470562fb34 service nova] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-adbd738c-4118-4089-9f9a-7ce739e83096 req-ca663c5c-7b5e-420d-8fef-5e470562fb34 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] No waiting events found dispatching network-vif-plugged-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:36:19 user nova-compute[73067]: WARNING nova.compute.manager [req-adbd738c-4118-4089-9f9a-7ce739e83096 req-ca663c5c-7b5e-420d-8fef-5e470562fb34 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received unexpected event network-vif-plugged-8775245b-73ca-43f0-b4cd-170134560df7 for instance with vm_state deleted and task_state None.
Aug 16 10:36:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-adbd738c-4118-4089-9f9a-7ce739e83096 req-ca663c5c-7b5e-420d-8fef-5e470562fb34 service nova] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Received event network-vif-deleted-8775245b-73ca-43f0-b4cd-170134560df7 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:36:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.278s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:19 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Deleted allocations for instance cca10fa3-1289-4ee9-b1d8-fe37afc92960
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0bbba2cc-5736-408c-bbdc-25dc9dc54d22 tempest-VolumesAdminNegativeTest-1324591370 tempest-VolumesAdminNegativeTest-1324591370-project-member] Lock "cca10fa3-1289-4ee9-b1d8-fe37afc92960" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.646s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-59010d8b-403e-4f09-89f0-2dac98792677 req-61ff2376-8642-4807-b995-8809d1f6c1fb service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event volume-reimaged-999ca751-8c68-4f24-b23a-8b5d0dca292b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-59010d8b-403e-4f09-89f0-2dac98792677 req-61ff2376-8642-4807-b995-8809d1f6c1fb service nova] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-59010d8b-403e-4f09-89f0-2dac98792677 req-61ff2376-8642-4807-b995-8809d1f6c1fb service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-59010d8b-403e-4f09-89f0-2dac98792677 req-61ff2376-8642-4807-b995-8809d1f6c1fb service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-59010d8b-403e-4f09-89f0-2dac98792677 req-61ff2376-8642-4807-b995-8809d1f6c1fb service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Processing event volume-reimaged-999ca751-8c68-4f24-b23a-8b5d0dca292b {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Instance event wait completed in 24 seconds for volume-reimaged {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:36:20 user nova-compute[73067]: INFO nova.virt.block_device [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Booting with volume 999ca751-8c68-4f24-b23a-8b5d0dca292b at /dev/vda
Aug 16 10:36:20 user nova-compute[73067]: DEBUG os_brick.utils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c275488-1038-43f2-805e-7422dd8f9786]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc09e43-b500-41cc-acc2-2986a0cfa17f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc2c846-eb9a-4ea7-a5e9-8ae8d8ca9624]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d829845-e394-42dc-9cf1-5cef575596a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:36:20 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:36:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e3e493-67a5-4013-91e8-a87aa7d0936f]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG os_brick.utils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:36:20 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Updating existing volume attachment record: 16b55f27-78f0-429c-8e02-3fab529e4d73 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:36:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:36:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:36:30 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid b51879a0-d5a1-4f96-b0c1-0672d31e80db {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Updating instance_info_cache with network_info: [{"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-b51879a0-d5a1-4f96-b0c1-0672d31e80db" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:36:31 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Creating image(s)
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Ensure instance console log exists: /opt/stack/data/nova/instances/6a791852-6268-4679-8b8f-e86eac3d5ad4/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Start _get_guest_xml network_info=[{"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNflELXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a791852-6268-4679-8b8f-e86eac3d5ad4', 'attached_at': '', 'detached_at': '', 'volume_id': '999ca751-8c68-4f24-b23a-8b5d0dca292b', 'serial': '999ca751-8c68-4f24-b23a-8b5d0dca292b'}, 'delete_on_termination': True, 'attachment_id': '16b55f27-78f0-429c-8e02-3fab529e4d73', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:36:31 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 10:36:31 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a791852-6268-4679-8b8f-e86eac3d5ad4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNflELXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:36:31 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 10:36:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:36:31 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 10:36:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:36:31 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45413a6-a4de-4160-8aba-9c2a94ed7b21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:36:31 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[67193bec-ece7-4d47-8523-e14e9a369467]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b] added
Aug 16 10:36:31 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[86477cd0-9465-4dcd-8aec-6daafde88d2b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff5d1c8-3649-48d0-a441-6bb37061d224]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNflELXc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNflELXc" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ac11f8-32c4-4c19-8c4d-032cb7747177]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DNflELXc'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d46ae5-c027-4c27-826c-3eb3e0d9f1c0]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e4bd39-74c4-4c21-a72a-25924b8c321a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cffa02-6022-42fe-9a47-07a5c2ad4693]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260]
Aug 16 10:36:32 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260] successful.
Aug 16 10:36:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[16180c89-a36f-42b9-a9d6-895c0eafa6f9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b21815-02f9-4723-941a-d31454e837ab]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:32 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:32 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[acacdad8-8a95-4e04-b2f4-c899536b1f11]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNflELXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182177.2822368, cca10fa3-1289-4ee9-b1d8-fe37afc92960 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:36:32 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] VM Stopped (Lifecycle Event)
Aug 16 10:36:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-948f1284-1161-4cb1-a4b5-cfe1fc413cd9 None None] [instance: cca10fa3-1289-4ee9-b1d8-fe37afc92960] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26465393531346438', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465393531346438', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1260743046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1270920761',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh0HAwQTZopjSQvK4nRNzkmupgLc79gEeAnD6JiXUo09M1Aow2M59+WM4PCI/pkDjFgU58/V8/dsPWTgCy06otTlpj2gcZiXpmpK3PlioaPiBZfU7RdCLMYdPEz4NhR+Q==',key_name='tempest-keypair-263281918',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:34:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ab3b5056f7f40b79a779c06def8f966',ramdisk_id='',reservation_id='r-eijqx0a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-327151388',owner_user_name='tempest-ServerActionsV293TestJSON-327151388-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a82f0b5e6de4d459a9f474ca9eef0a3',uuid=6a791852-6268-4679-8b8f-e86eac3d5ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converting VIF {"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:36:33 user nova-compute[73067]:   <uuid>6a791852-6268-4679-8b8f-e86eac3d5ad4</uuid>
Aug 16 10:36:33 user nova-compute[73067]:   <name>instance-00000011</name>
Aug 16 10:36:33 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:36:33 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:36:33 user nova-compute[73067]:   <metadata>
Aug 16 10:36:33 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:36:33 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:36:33 user nova-compute[73067]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1260743046</nova:name>
Aug 16 10:36:33 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:36:31</nova:creationTime>
Aug 16 10:36:33 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:36:33 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:36:33 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:36:33 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:36:33 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:36:33 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:36:33 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:36:33 user nova-compute[73067]:       <nova:owner>
Aug 16 10:36:33 user nova-compute[73067]:         <nova:user uuid="0a82f0b5e6de4d459a9f474ca9eef0a3">tempest-ServerActionsV293TestJSON-327151388-project-member</nova:user>
Aug 16 10:36:33 user nova-compute[73067]:         <nova:project uuid="8ab3b5056f7f40b79a779c06def8f966">tempest-ServerActionsV293TestJSON-327151388</nova:project>
Aug 16 10:36:33 user nova-compute[73067]:       </nova:owner>
Aug 16 10:36:33 user nova-compute[73067]:       <nova:ports>
Aug 16 10:36:33 user nova-compute[73067]:         <nova:port uuid="2a42b863-50bb-4a5e-acbe-69b57ef321d0">
Aug 16 10:36:33 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 10:36:33 user nova-compute[73067]:         </nova:port>
Aug 16 10:36:33 user nova-compute[73067]:       </nova:ports>
Aug 16 10:36:33 user nova-compute[73067]:     </nova:instance>
Aug 16 10:36:33 user nova-compute[73067]:   </metadata>
Aug 16 10:36:33 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:36:33 user nova-compute[73067]:     <system>
Aug 16 10:36:33 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:36:33 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:36:33 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:36:33 user nova-compute[73067]:       <entry name="serial">6a791852-6268-4679-8b8f-e86eac3d5ad4</entry>
Aug 16 10:36:33 user nova-compute[73067]:       <entry name="uuid">6a791852-6268-4679-8b8f-e86eac3d5ad4</entry>
Aug 16 10:36:33 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:36:33 user nova-compute[73067]:     </system>
Aug 16 10:36:33 user nova-compute[73067]:   </sysinfo>
Aug 16 10:36:33 user nova-compute[73067]:   <os>
Aug 16 10:36:33 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:36:33 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:36:33 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:36:33 user nova-compute[73067]:   </os>
Aug 16 10:36:33 user nova-compute[73067]:   <features>
Aug 16 10:36:33 user nova-compute[73067]:     <acpi/>
Aug 16 10:36:33 user nova-compute[73067]:     <apic/>
Aug 16 10:36:33 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:36:33 user nova-compute[73067]:   </features>
Aug 16 10:36:33 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:36:33 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:36:33 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:36:33 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:36:33 user nova-compute[73067]:   </clock>
Aug 16 10:36:33 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:36:33 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:36:33 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:36:33 user nova-compute[73067]:   </cpu>
Aug 16 10:36:33 user nova-compute[73067]:   <devices>
Aug 16 10:36:33 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:36:33 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:36:33 user nova-compute[73067]:       <source dev="/dev/sdc"/>
Aug 16 10:36:33 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:36:33 user nova-compute[73067]:       <serial>999ca751-8c68-4f24-b23a-8b5d0dca292b</serial>
Aug 16 10:36:33 user nova-compute[73067]:     </disk>
Aug 16 10:36:33 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:36:33 user nova-compute[73067]:       <mac address="fa:16:3e:cc:72:90"/>
Aug 16 10:36:33 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:36:33 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:36:33 user nova-compute[73067]:       <target dev="tap2a42b863-50"/>
Aug 16 10:36:33 user nova-compute[73067]:     </interface>
Aug 16 10:36:33 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:36:33 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/6a791852-6268-4679-8b8f-e86eac3d5ad4/console.log" append="off"/>
Aug 16 10:36:33 user nova-compute[73067]:     </serial>
Aug 16 10:36:33 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:36:33 user nova-compute[73067]:     <video>
Aug 16 10:36:33 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:36:33 user nova-compute[73067]:     </video>
Aug 16 10:36:33 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:36:33 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:36:33 user nova-compute[73067]:     </rng>
Aug 16 10:36:33 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:36:33 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:36:33 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:36:33 user nova-compute[73067]:     </memballoon>
Aug 16 10:36:33 user nova-compute[73067]:   </devices>
Aug 16 10:36:33 user nova-compute[73067]: </domain>
Aug 16 10:36:33 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1260743046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1270920761',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh0HAwQTZopjSQvK4nRNzkmupgLc79gEeAnD6JiXUo09M1Aow2M59+WM4PCI/pkDjFgU58/V8/dsPWTgCy06otTlpj2gcZiXpmpK3PlioaPiBZfU7RdCLMYdPEz4NhR+Q==',key_name='tempest-keypair-263281918',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:34:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ab3b5056f7f40b79a779c06def8f966',ramdisk_id='',reservation_id='r-eijqx0a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-327151388',owner_user_name='tempest-ServerActionsV293TestJSON-327151388-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a82f0b5e6de4d459a9f474ca9eef0a3',uuid=6a791852-6268-4679-8b8f-e86eac3d5ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converting VIF {"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG os_vif [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a42b863-50, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a42b863-50, col_values=(('external_ids', {'iface-id': '2a42b863-50bb-4a5e-acbe-69b57ef321d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:72:90', 'vm-uuid': '6a791852-6268-4679-8b8f-e86eac3d5ad4'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:33 user nova-compute[73067]: INFO os_vif [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50')
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] No VIF found with MAC fa:16:3e:cc:72:90, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-ff413e8f-fb1b-4743-b109-f353c007038d req-a9825b51-97c5-45ee-b938-fde7b2283037 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff413e8f-fb1b-4743-b109-f353c007038d req-a9825b51-97c5-45ee-b938-fde7b2283037 service nova] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff413e8f-fb1b-4743-b109-f353c007038d req-a9825b51-97c5-45ee-b938-fde7b2283037 service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff413e8f-fb1b-4743-b109-f353c007038d req-a9825b51-97c5-45ee-b938-fde7b2283037 service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-ff413e8f-fb1b-4743-b109-f353c007038d req-a9825b51-97c5-45ee-b938-fde7b2283037 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] No waiting events found dispatching network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:36:34 user nova-compute[73067]: WARNING nova.compute.manager [req-ff413e8f-fb1b-4743-b109-f353c007038d req-a9825b51-97c5-45ee-b938-fde7b2283037 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received unexpected event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 10:36:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182196.9640083, 6a791852-6268-4679-8b8f-e86eac3d5ad4 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:36:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] VM Resumed (Lifecycle Event)
Aug 16 10:36:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-23165f5c-33ae-4481-9816-acb260e304e3 req-750e9237-af85-42c2-8e27-315f18bb71fc service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-23165f5c-33ae-4481-9816-acb260e304e3 req-750e9237-af85-42c2-8e27-315f18bb71fc service nova] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-23165f5c-33ae-4481-9816-acb260e304e3 req-750e9237-af85-42c2-8e27-315f18bb71fc service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-23165f5c-33ae-4481-9816-acb260e304e3 req-750e9237-af85-42c2-8e27-315f18bb71fc service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-23165f5c-33ae-4481-9816-acb260e304e3 req-750e9237-af85-42c2-8e27-315f18bb71fc service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] No waiting events found dispatching network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:36:37 user nova-compute[73067]: WARNING nova.compute.manager [req-23165f5c-33ae-4481-9816-acb260e304e3 req-750e9237-af85-42c2-8e27-315f18bb71fc service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received unexpected event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-4ef1da1a-6cb5-410b-8c69-0154bd8a2664 req-fd8be2fe-b39f-4aac-aee5-b2c9d36b2fd1 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received event network-changed-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-4ef1da1a-6cb5-410b-8c69-0154bd8a2664 req-fd8be2fe-b39f-4aac-aee5-b2c9d36b2fd1 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Refreshing instance network info cache due to event network-changed-23ba3836-0532-4a97-aa9c-2fdbf6cbef26. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4ef1da1a-6cb5-410b-8c69-0154bd8a2664 req-fd8be2fe-b39f-4aac-aee5-b2c9d36b2fd1 service nova] Acquiring lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4ef1da1a-6cb5-410b-8c69-0154bd8a2664 req-fd8be2fe-b39f-4aac-aee5-b2c9d36b2fd1 service nova] Acquired lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.network.neutron [req-4ef1da1a-6cb5-410b-8c69-0154bd8a2664 req-fd8be2fe-b39f-4aac-aee5-b2c9d36b2fd1 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Refreshing network info cache for port 23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:36:37 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:36:37 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7118MB free_disk=25.390472412109375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:37 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Instance spawned successfully.
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:36:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182196.9664986, 6a791852-6268-4679-8b8f-e86eac3d5ad4 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:36:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] VM Started (Lifecycle Event)
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:36:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b51879a0-d5a1-4f96-b0c1-0672d31e80db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ffe1f07d-0a48-431d-be98-7e78018faa10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6a791852-6268-4679-8b8f-e86eac3d5ad4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fcb6379a-4c57-462b-a4ea-9680340a5137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0f85b78e-78c3-4e5a-a33d-ace04474a737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance bc035e99-1a53-43df-8946-9c86ce2ecb0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:36:37 user nova-compute[73067]: INFO nova.compute.manager [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] instance snapshotting
Aug 16 10:36:37 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Beginning live snapshot process
Aug 16 10:36:37 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.398s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG nova.objects.instance [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73067) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json -f qcow2 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG nova.network.neutron [req-4ef1da1a-6cb5-410b-8c69-0154bd8a2664 req-fd8be2fe-b39f-4aac-aee5-b2c9d36b2fd1 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Updated VIF entry in instance network info cache for port 23ba3836-0532-4a97-aa9c-2fdbf6cbef26. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG nova.network.neutron [req-4ef1da1a-6cb5-410b-8c69-0154bd8a2664 req-fd8be2fe-b39f-4aac-aee5-b2c9d36b2fd1 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Updating instance_info_cache with network_info: [{"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4ef1da1a-6cb5-410b-8c69-0154bd8a2664 req-fd8be2fe-b39f-4aac-aee5-b2c9d36b2fd1 service nova] Releasing lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-59010d8b-403e-4f09-89f0-2dac98792677 tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.162s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json -f qcow2 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.230s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp02c5i7mm/2691e510631d4d67b3e15b9d0c966b58.delta 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp02c5i7mm/2691e510631d4d67b3e15b9d0c966b58.delta 1073741824" returned: 0 in 0.095s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 10:36:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:36:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:36:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:36:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:36:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:36:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:36:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] COPY block job progress, current cursor: 47382528 final cursor: 75497472 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:36:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:36:40 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 10:36:41 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:36:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp02c5i7mm/2691e510631d4d67b3e15b9d0c966b58.delta /opt/stack/data/nova/instances/snapshots/tmp02c5i7mm/2691e510631d4d67b3e15b9d0c966b58 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp02c5i7mm/2691e510631d4d67b3e15b9d0c966b58.delta /opt/stack/data/nova/instances/snapshots/tmp02c5i7mm/2691e510631d4d67b3e15b9d0c966b58" returned: 0 in 0.637s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Snapshot extracted, beginning image upload
Aug 16 10:36:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-d609897e-40f5-4ec8-b283-d0ca5769363e req-2b53896e-40d3-4f1f-8028-c5b20199707e service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received event network-changed-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-d609897e-40f5-4ec8-b283-d0ca5769363e req-2b53896e-40d3-4f1f-8028-c5b20199707e service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Refreshing instance network info cache due to event network-changed-00b9e9ea-45dd-4562-b426-4d1138de93b4. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d609897e-40f5-4ec8-b283-d0ca5769363e req-2b53896e-40d3-4f1f-8028-c5b20199707e service nova] Acquiring lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d609897e-40f5-4ec8-b283-d0ca5769363e req-2b53896e-40d3-4f1f-8028-c5b20199707e service nova] Acquired lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG nova.network.neutron [req-d609897e-40f5-4ec8-b283-d0ca5769363e req-2b53896e-40d3-4f1f-8028-c5b20199707e service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Refreshing network info cache for port 00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG nova.objects.instance [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'flavor' on Instance uuid 2448aa3f-a0a6-43c6-8844-dbfb8145d779 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:42 user nova-compute[73067]: INFO nova.compute.manager [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Attaching volume a4634a36-dbdd-4bcd-b251-ebf7021db0d1 to /dev/vdb
Aug 16 10:36:42 user nova-compute[73067]: DEBUG os_brick.utils [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[218d10db-7be7-4c95-9a84-db4e92e280a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.040s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed31a6d3-8e25-4ac9-8a7f-fa13013c995c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'flavor' on Instance uuid fcb6379a-4c57-462b-a4ea-9680340a5137 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce08e258-bbc8-43de-ae5e-87461a4b3e49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b047e9f-90a5-4dd2-9826-47dad6a844d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:36:43 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d796bd8f-f8cb-42cc-906a-0428f5853b0e]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.utils [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Updating existing volume attachment record: 7e84a8c4-293d-46ef-8507-9eca6178d706 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG nova.network.neutron [req-d609897e-40f5-4ec8-b283-d0ca5769363e req-2b53896e-40d3-4f1f-8028-c5b20199707e service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updated VIF entry in instance network info cache for port 00b9e9ea-45dd-4562-b426-4d1138de93b4. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG nova.network.neutron [req-d609897e-40f5-4ec8-b283-d0ca5769363e req-2b53896e-40d3-4f1f-8028-c5b20199707e service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updating instance_info_cache with network_info: [{"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.162s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d609897e-40f5-4ec8-b283-d0ca5769363e req-2b53896e-40d3-4f1f-8028-c5b20199707e service nova] Releasing lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:43 user nova-compute[73067]: INFO nova.compute.manager [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Attaching volume 6da682c9-bd14-4be8-aad0-59352a4fb0b6 to /dev/vdb
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.utils [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fb0014-08b5-4e17-802b-722eb4373efd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[237b06d4-cb39-4596-b5a9-06452edce201]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a5579e-209f-4fe6-bb38-856aa5585aed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[609b1f00-e06c-498c-9402-9ff21f744379]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:36:43 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:36:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[94594fcd-120d-4305-ac8c-943c37474827]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG os_brick.utils [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:36:43 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updating existing volume attachment record: 50eb08d6-a97c-4191-92c4-7ea9b9b795d2 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:36:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Snapshot image upload complete
Aug 16 10:36:44 user nova-compute[73067]: INFO nova.compute.manager [None req-854ac1b1-103f-4950-a61b-5a9d5155553f tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Took 6.88 seconds to snapshot the instance on the hypervisor.
Aug 16 10:36:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-344fc045-2e57-47dd-8c07-50de668dccdd req-028a3a59-2c3d-4ad0-ab21-2c9767593cce service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received event network-changed-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:36:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-344fc045-2e57-47dd-8c07-50de668dccdd req-028a3a59-2c3d-4ad0-ab21-2c9767593cce service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Refreshing instance network info cache due to event network-changed-b72f8a84-e264-4da0-b7da-0ab8750b046a. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:36:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-344fc045-2e57-47dd-8c07-50de668dccdd req-028a3a59-2c3d-4ad0-ab21-2c9767593cce service nova] Acquiring lock "refresh_cache-0f85b78e-78c3-4e5a-a33d-ace04474a737" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:36:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-344fc045-2e57-47dd-8c07-50de668dccdd req-028a3a59-2c3d-4ad0-ab21-2c9767593cce service nova] Acquired lock "refresh_cache-0f85b78e-78c3-4e5a-a33d-ace04474a737" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:36:50 user nova-compute[73067]: DEBUG nova.network.neutron [req-344fc045-2e57-47dd-8c07-50de668dccdd req-028a3a59-2c3d-4ad0-ab21-2c9767593cce service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Refreshing network info cache for port b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lazy-loading 'flavor' on Instance uuid 0f85b78e-78c3-4e5a-a33d-ace04474a737 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-344fc045-2e57-47dd-8c07-50de668dccdd req-028a3a59-2c3d-4ad0-ab21-2c9767593cce service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Updated VIF entry in instance network info cache for port b72f8a84-e264-4da0-b7da-0ab8750b046a. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-344fc045-2e57-47dd-8c07-50de668dccdd req-028a3a59-2c3d-4ad0-ab21-2c9767593cce service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Updating instance_info_cache with network_info: [{"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-344fc045-2e57-47dd-8c07-50de668dccdd req-028a3a59-2c3d-4ad0-ab21-2c9767593cce service nova] Releasing lock "refresh_cache-0f85b78e-78c3-4e5a-a33d-ace04474a737" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:36:51 user nova-compute[73067]: INFO nova.compute.manager [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Attaching volume fd70f018-123d-4e2f-b21e-7d018b36be6a to /dev/vdb
Aug 16 10:36:51 user nova-compute[73067]: DEBUG os_brick.utils [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[99254a45-57a4-4037-ba7f-5b4fff2f6000]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b051b2ff-d9d0-4793-88f1-92c4ed0b94d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a8b99a-5fad-4f96-9e61-5bbb44a55420]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6e6c4a-6115-4be0-a09c-bc3e31945701]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:36:51 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:36:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f988b5f-04af-449d-a262-a75ddc4707d1]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG os_brick.utils [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:36:51 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Updating existing volume attachment record: 1e12be4b-8886-44e9-ab07-1dd1ad6eba4e {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:36:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZxeWuCco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:36:54 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:36:54 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:36:54 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8527d781-e0e0-48aa-9085-51f5c8711d0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:36:54 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6e88d6-99fa-4188-af1d-9f8a24122b04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1] added
Aug 16 10:36:54 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f015b2-3f6a-42b1-bae6-721f1f7a78b6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb8aa42-21c5-4286-a150-e9b177e9c2c6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZxeWuCco {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZxeWuCco" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24e2008-6d3b-4c70-ae82-a35126f8c5fd]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZxeWuCco'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5da023-52d5-499e-8a4d-5f303fd509d9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d813842a-e5b6-4c24-aad1-6069cf2fa06b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:54 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:54 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:54 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:54 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7b2fe2-a050-4afc-9ded-37dd371c61e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1, portal: 172.16.0.220,3260]
Aug 16 10:36:54 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1, portal: 172.16.0.220,3260] successful.
Aug 16 10:36:54 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e416f-a2cd-448b-a881-e7b16e65cc92]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0030a8a2-12bb-462c-868e-71d9045f52d9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:54 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:54 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:36:54 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:54 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:54 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:36:54 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd6ed97-c843-4366-8c66-e153bd2d8661]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:54 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csPuRZey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:36:55 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZxeWuCco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23830313063316165', 'path': '/dev/sdd'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830313063316165', 'path': '/dev/sdd'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.360s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:36:55 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:36:55 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG nova.objects.instance [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'flavor' on Instance uuid 2448aa3f-a0a6-43c6-8844-dbfb8145d779 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f11f0e-98a7-4b9b-90d8-380c869d6fff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:36:55 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:36:55 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:36:55 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 10:36:55 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:36:55 user nova-compute[73067]:   <serial>a4634a36-dbdd-4bcd-b251-ebf7021db0d1</serial>
Aug 16 10:36:55 user nova-compute[73067]: </disk>
Aug 16 10:36:55 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37db72c-adaa-4b34-97ae-532be91d5602]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6] added
Aug 16 10:36:55 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d147f13e-3775-43f2-a604-71a98d2814a9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa9710f-a9cc-48be-a9fb-f07f3abc4348]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csPuRZey {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csPuRZey" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[298527f7-2fd7-4ddc-864d-7bec46f062af]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'csPuRZey'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c761e7bb-eb5a-45a6-84dc-46fbf3b2ddf2]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0c95bc-a337-464f-b8e6-d9f31ba9a299]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:55 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:55 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:36:55 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:55 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:55 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:36:55 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c05c4ba-b843-4c40-8bf1-bf89ec0cead5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6, portal: 172.16.0.220,3260]
Aug 16 10:36:55 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6, portal: 172.16.0.220,3260] successful.
Aug 16 10:36:55 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b230819-adfe-4cff-a716-ec4b09ac6634]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7998e8-f65b-43b3-9083-66ca69ae5f97]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:55 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:55 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:36:55 user nova-compute[73067]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 (non-flash)
Aug 16 10:36:55 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:36:55 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:36:55 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:36:55 user nova-compute[73067]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 (non-flash)
Aug 16 10:36:55 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b87935-810c-4b58-a557-8f45805cf869]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:36:55 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No VIF found with MAC fa:16:3e:ae:d4:32, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-717a4638-cde1-4bce-90db-b431457318a0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.337s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csPuRZey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] <== connect_volume: return (1700ms) {'type': 'block', 'scsi_wwn': '23862653239643834', 'path': '/dev/sde'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862653239643834', 'path': '/dev/sde'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'flavor' on Instance uuid fcb6379a-4c57-462b-a4ea-9680340a5137 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:36:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:36:56 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:36:56 user nova-compute[73067]:   <source dev="/dev/sde"/>
Aug 16 10:36:56 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:36:56 user nova-compute[73067]:   <serial>6da682c9-bd14-4be8-aad0-59352a4fb0b6</serial>
Aug 16 10:36:56 user nova-compute[73067]: </disk>
Aug 16 10:36:56 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:36:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:36:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:36:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] No VIF found with MAC fa:16:3e:1c:e6:b8, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:36:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e7d6d299-e42d-4a61-9449-109b7e0b1f37 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.184s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:36:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "74a885f5-8405-444e-a620-ddd0ef0d1641" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:37:00 user nova-compute[73067]: INFO nova.compute.claims [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Claim successful on node user
Aug 16 10:37:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:00 user nova-compute[73067]: INFO nova.compute.manager [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Detaching volume 6da682c9-bd14-4be8-aad0-59352a4fb0b6
Aug 16 10:37:00 user nova-compute[73067]: INFO nova.virt.block_device [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Attempting to driver detach volume 6da682c9-bd14-4be8-aad0-59352a4fb0b6 from mountpoint /dev/vdb
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Attempting to detach device vdb from instance fcb6379a-4c57-462b-a4ea-9680340a5137 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:37:00 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:37:00 user nova-compute[73067]:   <source dev="/dev/sde"/>
Aug 16 10:37:00 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:37:00 user nova-compute[73067]:   <serial>6da682c9-bd14-4be8-aad0-59352a4fb0b6</serial>
Aug 16 10:37:00 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:37:00 user nova-compute[73067]: </disk>
Aug 16 10:37:00 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:37:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Successfully detached device vdb from instance fcb6379a-4c57-462b-a4ea-9680340a5137 from the persistent domain config.
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcb6379a-4c57-462b-a4ea-9680340a5137 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:37:00 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:37:00 user nova-compute[73067]:   <source dev="/dev/sde"/>
Aug 16 10:37:00 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:37:00 user nova-compute[73067]:   <serial>6da682c9-bd14-4be8-aad0-59352a4fb0b6</serial>
Aug 16 10:37:00 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:37:00 user nova-compute[73067]: </disk>
Aug 16 10:37:00 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.network.neutron [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:37:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:37:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG nova.policy [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be44e520761a493aab4b2a5973edd39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ce3a633ff54025aebcee0c30986ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:37:01 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Creating image(s)
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "/opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "/opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "/opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182221.2395244, fcb6379a-4c57-462b-a4ea-9680340a5137 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcb6379a-4c57-462b-a4ea-9680340a5137 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:37:01 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Successfully detached device vdb from instance fcb6379a-4c57-462b-a4ea-9680340a5137 from the live domain config.
Aug 16 10:37:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csPuRZey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:37:01 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe1cbd5-1de0-444f-988f-02d24444d1fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffe522f-3e4a-4b56-a64f-71bc5aa703fb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:01 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:01 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:01 user nova-compute[73067]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 (non-flash)
Aug 16 10:37:01 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:01 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:01 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:01 user nova-compute[73067]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 (non-flash)
Aug 16 10:37:01 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f358414a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6'): ({'sde'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Removing single pathed devices sde {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f078f39-f18e-4637-ba0f-e36e13682572]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.114s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7525d44-c48e-4138-b8a4-2c702f6d1df0]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Flushing IO for device /dev/sde {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.203s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4c75a2-f2a6-43b2-83e5-6bbd80b1c745]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk 1073741824" returned: 0 in 0.054s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f56d92-e346-4d4e-bc61-7bfd91435fcb]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] SCSI volumes sde have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[12886922-9bf9-4be4-aa42-fb7ce04aa8b9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aefa738-1098-4a9c-99f2-31808090207c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6, portal: 172.16.0.220,3260]
Aug 16 10:37:01 user nova-compute[73067]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6, portal: 172.16.0.220,3260] successful.
Aug 16 10:37:01 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da682c9-bd14-4be8-aad0-59352a4fb0b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1436fa3b-435a-4be5-99a2-360ff216646e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] <== disconnect_volume: return (492ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.217s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:01 user nova-compute[73067]: INFO nova.compute.manager [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Terminating instance
Aug 16 10:37:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.network.neutron [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Successfully created port: a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Cannot resize image /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.objects.instance [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'migration_context' on Instance uuid 74a885f5-8405-444e-a620-ddd0ef0d1641 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Ensure instance console log exists: /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-46f466ee-8fce-442f-b9e8-305e31b8907e req-f46756b6-27c9-40ee-a100-64d262ce6218 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-unplugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-46f466ee-8fce-442f-b9e8-305e31b8907e req-f46756b6-27c9-40ee-a100-64d262ce6218 service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-46f466ee-8fce-442f-b9e8-305e31b8907e req-f46756b6-27c9-40ee-a100-64d262ce6218 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-46f466ee-8fce-442f-b9e8-305e31b8907e req-f46756b6-27c9-40ee-a100-64d262ce6218 service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-46f466ee-8fce-442f-b9e8-305e31b8907e req-f46756b6-27c9-40ee-a100-64d262ce6218 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-unplugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-46f466ee-8fce-442f-b9e8-305e31b8907e req-f46756b6-27c9-40ee-a100-64d262ce6218 service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-unplugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'flavor' on Instance uuid fcb6379a-4c57-462b-a4ea-9680340a5137 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e527af1e-d1f6-4e3f-85f6-a48119489618 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.053s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:02 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Instance destroyed successfully.
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.objects.instance [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lazy-loading 'resources' on Instance uuid 6956e66e-229d-4f95-9d0b-d1e8c89a5360 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-93500555',display_name='tempest-ServerStableDeviceRescueTest-server-93500555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-93500555',id=4,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnCGChHF3jYXGv2a0SHt5NHUCA92tAWiyv6m86NOx27TMrH8SPc4MLN1jNe9CWzd+kqNF+W4jHQLPaqZl0HDJ27dCKHPSMKrqtlGkbEQO6HvoCiRyAhtMQHATGwVjhGYw==',key_name='tempest-keypair-504698564',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9a85655eedd4d9c9aeb5320fa880c5b',ramdisk_id='',reservation_id='r-gdsl9tze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1826914324',owner_user_name='tempest-ServerStableDeviceRescueTest-1826914324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bcfa5c264949eaa13c3f7620340b3c',uuid=6956e66e-229d-4f95-9d0b-d1e8c89a5360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Converting VIF {"id": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "address": "fa:16:3e:46:e1:81", "network": {"id": "9466980a-cc9b-4b41-b2dc-836642bfa8aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1203224578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9a85655eedd4d9c9aeb5320fa880c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50ee3f9-3e", "ovs_interfaceid": "c50ee3f9-3e3b-4896-a303-bdbf8153b3a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=c50ee3f9-3e3b-4896-a303-bdbf8153b3a1,network=Network(9466980a-cc9b-4b41-b2dc-836642bfa8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50ee3f9-3e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG os_vif [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=c50ee3f9-3e3b-4896-a303-bdbf8153b3a1,network=Network(9466980a-cc9b-4b41-b2dc-836642bfa8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50ee3f9-3e') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc50ee3f9-3e, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:37:02 user nova-compute[73067]: INFO os_vif [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=c50ee3f9-3e3b-4896-a303-bdbf8153b3a1,network=Network(9466980a-cc9b-4b41-b2dc-836642bfa8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50ee3f9-3e')
Aug 16 10:37:02 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Deleting instance files /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360_del
Aug 16 10:37:02 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Deletion of /opt/stack/data/nova/instances/6956e66e-229d-4f95-9d0b-d1e8c89a5360_del complete
Aug 16 10:37:02 user nova-compute[73067]: INFO nova.compute.manager [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 16 10:37:02 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:37:02 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.network.neutron [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Successfully updated port: a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "refresh_cache-74a885f5-8405-444e-a620-ddd0ef0d1641" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquired lock "refresh_cache-74a885f5-8405-444e-a620-ddd0ef0d1641" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.network.neutron [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.network.neutron [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] Acquiring lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] No waiting events found dispatching network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:37:04 user nova-compute[73067]: WARNING nova.compute.manager [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received unexpected event network-vif-plugged-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 for instance with vm_state active and task_state deleting.
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received event network-changed-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Refreshing instance network info cache due to event network-changed-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] Acquiring lock "refresh_cache-74a885f5-8405-444e-a620-ddd0ef0d1641" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:37:04 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Took 1.83 seconds to deallocate network for instance.
Aug 16 10:37:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.network.neutron [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Updating instance_info_cache with network_info: [{"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Releasing lock "refresh_cache-74a885f5-8405-444e-a620-ddd0ef0d1641" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Instance network_info: |[{"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] Acquired lock "refresh_cache-74a885f5-8405-444e-a620-ddd0ef0d1641" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.network.neutron [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Refreshing network info cache for port a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Start _get_guest_xml network_info=[{"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:37:04 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:37:04 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:37:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-679794657',display_name='tempest-AttachVolumeNegativeTest-server-679794657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-679794657',id=23,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7IscvtNy8DrQENDGSMs0r5oP9QP+NVzt+jn2p/lPeYgMTkke3gGn6SMDgtaACkWeVFYE4Q5foswGo86PgT1zCB8sS6wJn7I1QyZZCqGCNjtDsBuWAuy3LgSLdTHgUm5g==',key_name='tempest-keypair-973130580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-7trh0ig2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=74a885f5-8405-444e-a620-ddd0ef0d1641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0f:55,bridge_name='br-int',has_traffic_filtering=True,id=a72becbf-c6c6-424f-ac4c-d114f5f7eb3c,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72becbf-c6') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.objects.instance [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'pci_devices' on Instance uuid 74a885f5-8405-444e-a620-ddd0ef0d1641 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:37:05 user nova-compute[73067]:   <uuid>74a885f5-8405-444e-a620-ddd0ef0d1641</uuid>
Aug 16 10:37:05 user nova-compute[73067]:   <name>instance-00000017</name>
Aug 16 10:37:05 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:37:05 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:37:05 user nova-compute[73067]:   <metadata>
Aug 16 10:37:05 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:37:05 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:37:05 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeNegativeTest-server-679794657</nova:name>
Aug 16 10:37:05 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:37:04</nova:creationTime>
Aug 16 10:37:05 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:37:05 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:37:05 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:37:05 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:37:05 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:37:05 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:37:05 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:37:05 user nova-compute[73067]:       <nova:owner>
Aug 16 10:37:05 user nova-compute[73067]:         <nova:user uuid="be44e520761a493aab4b2a5973edd39c">tempest-AttachVolumeNegativeTest-630141842-project-member</nova:user>
Aug 16 10:37:05 user nova-compute[73067]:         <nova:project uuid="52ce3a633ff54025aebcee0c30986ad9">tempest-AttachVolumeNegativeTest-630141842</nova:project>
Aug 16 10:37:05 user nova-compute[73067]:       </nova:owner>
Aug 16 10:37:05 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:37:05 user nova-compute[73067]:       <nova:ports>
Aug 16 10:37:05 user nova-compute[73067]:         <nova:port uuid="a72becbf-c6c6-424f-ac4c-d114f5f7eb3c">
Aug 16 10:37:05 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 10:37:05 user nova-compute[73067]:         </nova:port>
Aug 16 10:37:05 user nova-compute[73067]:       </nova:ports>
Aug 16 10:37:05 user nova-compute[73067]:     </nova:instance>
Aug 16 10:37:05 user nova-compute[73067]:   </metadata>
Aug 16 10:37:05 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:37:05 user nova-compute[73067]:     <system>
Aug 16 10:37:05 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:37:05 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:37:05 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:37:05 user nova-compute[73067]:       <entry name="serial">74a885f5-8405-444e-a620-ddd0ef0d1641</entry>
Aug 16 10:37:05 user nova-compute[73067]:       <entry name="uuid">74a885f5-8405-444e-a620-ddd0ef0d1641</entry>
Aug 16 10:37:05 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:37:05 user nova-compute[73067]:     </system>
Aug 16 10:37:05 user nova-compute[73067]:   </sysinfo>
Aug 16 10:37:05 user nova-compute[73067]:   <os>
Aug 16 10:37:05 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:37:05 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:37:05 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:37:05 user nova-compute[73067]:   </os>
Aug 16 10:37:05 user nova-compute[73067]:   <features>
Aug 16 10:37:05 user nova-compute[73067]:     <acpi/>
Aug 16 10:37:05 user nova-compute[73067]:     <apic/>
Aug 16 10:37:05 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:37:05 user nova-compute[73067]:   </features>
Aug 16 10:37:05 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:37:05 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:37:05 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:37:05 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:37:05 user nova-compute[73067]:   </clock>
Aug 16 10:37:05 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:37:05 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:37:05 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:37:05 user nova-compute[73067]:   </cpu>
Aug 16 10:37:05 user nova-compute[73067]:   <devices>
Aug 16 10:37:05 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:37:05 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:37:05 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk"/>
Aug 16 10:37:05 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:37:05 user nova-compute[73067]:     </disk>
Aug 16 10:37:05 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:37:05 user nova-compute[73067]:       <mac address="fa:16:3e:65:0f:55"/>
Aug 16 10:37:05 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:37:05 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:37:05 user nova-compute[73067]:       <target dev="tapa72becbf-c6"/>
Aug 16 10:37:05 user nova-compute[73067]:     </interface>
Aug 16 10:37:05 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:37:05 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/console.log" append="off"/>
Aug 16 10:37:05 user nova-compute[73067]:     </serial>
Aug 16 10:37:05 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:37:05 user nova-compute[73067]:     <video>
Aug 16 10:37:05 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:37:05 user nova-compute[73067]:     </video>
Aug 16 10:37:05 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:37:05 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:37:05 user nova-compute[73067]:     </rng>
Aug 16 10:37:05 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:37:05 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:37:05 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:37:05 user nova-compute[73067]:     </memballoon>
Aug 16 10:37:05 user nova-compute[73067]:   </devices>
Aug 16 10:37:05 user nova-compute[73067]: </domain>
Aug 16 10:37:05 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-679794657',display_name='tempest-AttachVolumeNegativeTest-server-679794657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-679794657',id=23,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7IscvtNy8DrQENDGSMs0r5oP9QP+NVzt+jn2p/lPeYgMTkke3gGn6SMDgtaACkWeVFYE4Q5foswGo86PgT1zCB8sS6wJn7I1QyZZCqGCNjtDsBuWAuy3LgSLdTHgUm5g==',key_name='tempest-keypair-973130580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-7trh0ig2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=74a885f5-8405-444e-a620-ddd0ef0d1641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0f:55,bridge_name='br-int',has_traffic_filtering=True,id=a72becbf-c6c6-424f-ac4c-d114f5f7eb3c,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72becbf-c6') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_vif [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0f:55,bridge_name='br-int',has_traffic_filtering=True,id=a72becbf-c6c6-424f-ac4c-d114f5f7eb3c,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72becbf-c6') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa72becbf-c6, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa72becbf-c6, col_values=(('external_ids', {'iface-id': 'a72becbf-c6c6-424f-ac4c-d114f5f7eb3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:0f:55', 'vm-uuid': '74a885f5-8405-444e-a620-ddd0ef0d1641'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:05 user nova-compute[73067]: INFO os_vif [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0f:55,bridge_name='br-int',has_traffic_filtering=True,id=a72becbf-c6c6-424f-ac4c-d114f5f7eb3c,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72becbf-c6')
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No VIF found with MAC fa:16:3e:65:0f:55, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:05 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Deleted allocations for instance 6956e66e-229d-4f95-9d0b-d1e8c89a5360
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqpsCGmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:37:05 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:37:05 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:37:05 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ddbf60-57a6-4653-90a5-be26004f514b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:37:05 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a427411-5fb8-4fec-b0f2-8d6e50a72891]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a] added
Aug 16 10:37:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41051ff-f99b-450e-9152-6264c76a660c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-03c7f6f4-e091-4dfc-8e56-96d47ab6d9d8 tempest-ServerStableDeviceRescueTest-1826914324 tempest-ServerStableDeviceRescueTest-1826914324-project-member] Lock "6956e66e-229d-4f95-9d0b-d1e8c89a5360" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.549s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe896bc-1387-41ff-bcf0-28fbd7ec69b9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QqpsCGmW {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QqpsCGmW" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcbb3e2-2113-40ef-9152-0cbafe3f8b2e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QqpsCGmW'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.network.neutron [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Updated VIF entry in instance network info cache for port a72becbf-c6c6-424f-ac4c-d114f5f7eb3c. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG nova.network.neutron [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Updating instance_info_cache with network_info: [{"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0540143-f0d2-45ea-bbf0-2adc92ebbf18]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8f9a419f-abcd-447c-999d-5f04b5568ac5 req-1d21d7e9-baab-48af-b54d-ad2e24d1d4bc service nova] Releasing lock "refresh_cache-74a885f5-8405-444e-a620-ddd0ef0d1641" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88da2b4-6fc9-453c-ac8f-57c5a76e5e07]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:05 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:05 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:05 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:05 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c7cedc-0430-46bb-9fff-e389d874c5d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a, portal: 172.16.0.220,3260]
Aug 16 10:37:05 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a, portal: 172.16.0.220,3260] successful.
Aug 16 10:37:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5545e7a7-0c5e-41e4-8bef-ae805c278b98]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[61066d3e-e9cb-4c18-b09c-8585e45c8144]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:05 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:05 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:05 user nova-compute[73067]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)
Aug 16 10:37:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:05 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:05 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:05 user nova-compute[73067]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)
Aug 16 10:37:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9919fd-7bc3-46e2-90f8-d6a3e4a04ccc]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:05 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-43313dab-e267-4a9c-8627-172121147f44 req-fd15780d-4676-4151-a4aa-2e58331c934d service nova] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Received event network-vif-deleted-c50ee3f9-3e3b-4896-a303-bdbf8153b3a1 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqpsCGmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26134643764363730', 'path': '/dev/sde'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134643764363730', 'path': '/dev/sde'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lazy-loading 'flavor' on Instance uuid 0f85b78e-78c3-4e5a-a33d-ace04474a737 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-8302cced-c415-4cba-9470-6c6bc3a8c466 req-3cfd134a-7b57-4e1e-8cf7-f67530711c90 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received event network-vif-plugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8302cced-c415-4cba-9470-6c6bc3a8c466 req-3cfd134a-7b57-4e1e-8cf7-f67530711c90 service nova] Acquiring lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8302cced-c415-4cba-9470-6c6bc3a8c466 req-3cfd134a-7b57-4e1e-8cf7-f67530711c90 service nova] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8302cced-c415-4cba-9470-6c6bc3a8c466 req-3cfd134a-7b57-4e1e-8cf7-f67530711c90 service nova] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-8302cced-c415-4cba-9470-6c6bc3a8c466 req-3cfd134a-7b57-4e1e-8cf7-f67530711c90 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] No waiting events found dispatching network-vif-plugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:37:06 user nova-compute[73067]: WARNING nova.compute.manager [req-8302cced-c415-4cba-9470-6c6bc3a8c466 req-3cfd134a-7b57-4e1e-8cf7-f67530711c90 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received unexpected event network-vif-plugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c for instance with vm_state building and task_state spawning.
Aug 16 10:37:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:37:06 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:37:06 user nova-compute[73067]:   <source dev="/dev/sde"/>
Aug 16 10:37:06 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:37:06 user nova-compute[73067]:   <serial>fd70f018-123d-4e2f-b21e-7d018b36be6a</serial>
Aug 16 10:37:06 user nova-compute[73067]: </disk>
Aug 16 10:37:06 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:37:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:37:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:37:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] No VIF found with MAC fa:16:3e:45:38:13, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:37:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ec0f43f7-4b7c-4844-bcd1-42538258ee46 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.014s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-6c53f157-19f2-454d-abfd-b0e4ca19d7e4 req-5cbd3dbf-c65b-477e-bad3-877c6e948f5c service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received event network-vif-plugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c53f157-19f2-454d-abfd-b0e4ca19d7e4 req-5cbd3dbf-c65b-477e-bad3-877c6e948f5c service nova] Acquiring lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c53f157-19f2-454d-abfd-b0e4ca19d7e4 req-5cbd3dbf-c65b-477e-bad3-877c6e948f5c service nova] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c53f157-19f2-454d-abfd-b0e4ca19d7e4 req-5cbd3dbf-c65b-477e-bad3-877c6e948f5c service nova] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-6c53f157-19f2-454d-abfd-b0e4ca19d7e4 req-5cbd3dbf-c65b-477e-bad3-877c6e948f5c service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] No waiting events found dispatching network-vif-plugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:37:08 user nova-compute[73067]: WARNING nova.compute.manager [req-6c53f157-19f2-454d-abfd-b0e4ca19d7e4 req-5cbd3dbf-c65b-477e-bad3-877c6e948f5c service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received unexpected event network-vif-plugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c for instance with vm_state building and task_state spawning.
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG os_brick.utils [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4870f54-8e03-40af-82f9-384ba6b261ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[846f46e6-82d3-4b3c-993a-de70388a3b3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8276a8-b8d9-44b0-8509-6a90a0358bd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45446e5-07d3-4498-82b7-c27a60254491]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:37:09 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9be9ae0-095f-42f6-9ff7-5a09ea873228]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG os_brick.utils [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182229.2994971, 74a885f5-8405-444e-a620-ddd0ef0d1641 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:37:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] VM Resumed (Lifecycle Event)
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:37:09 user nova-compute[73067]: INFO nova.compute.manager [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Swapping volume fd70f018-123d-4e2f-b21e-7d018b36be6a for 0368e3e4-ecb6-4f51-afa1-19159cdb99fd
Aug 16 10:37:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Instance spawned successfully.
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:37:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182229.3021445, 74a885f5-8405-444e-a620-ddd0ef0d1641 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:37:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] VM Started (Lifecycle Event)
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:37:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:37:09 user nova-compute[73067]: INFO nova.compute.manager [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Took 8.35 seconds to spawn the instance on the hypervisor.
Aug 16 10:37:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:37:09 user nova-compute[73067]: INFO nova.compute.manager [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Took 9.29 seconds to build instance.
Aug 16 10:37:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-56ede194-7cc6-4fbc-a1b3-79ae036fc101 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.408s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:17 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182222.6953483, 6956e66e-229d-4f95-9d0b-d1e8c89a5360 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:37:17 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] VM Stopped (Lifecycle Event)
Aug 16 10:37:17 user nova-compute[73067]: DEBUG nova.compute.manager [None req-906ae037-ffc3-43f1-933a-3ca8f2d177bc None None] [instance: 6956e66e-229d-4f95-9d0b-d1e8c89a5360] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:37:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJWAqkLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f85b78e-78c3-4e5a-a33d-ace04474a737', 'attached_at': '', 'detached_at': '', 'volume_id': '0368e3e4-ecb6-4f51-afa1-19159cdb99fd', 'serial': '0368e3e4-ecb6-4f51-afa1-19159cdb99fd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqpsCGmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '0f85b78e-78c3-4e5a-a33d-ace04474a737', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd70f018-123d-4e2f-b21e-7d018b36be6a', 'serial'} {{(pid=73067) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJWAqkLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:37:23 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:37:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:37:23 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:37:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:37:23 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7973e2e2-a8c9-4e33-8e95-dd385aac49f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:37:23 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2defe15c-8032-4205-965b-748733a74b4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd] added
Aug 16 10:37:23 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f11991e-402f-42ec-a72d-37d00df1bfae]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e3f003-a0bc-42d6-b8a5-661e58cf68bc]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJWAqkLP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJWAqkLP" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4882cd6c-ed2b-4907-b2ac-c63c09e00a76]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rJWAqkLP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5883d2f3-6612-4be3-a1fa-9b3bce5d56b3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbace6e-880a-4111-a1b8-a5b350d09d6d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)
Aug 16 10:37:24 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)
Aug 16 10:37:24 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24ebe20-a726-4596-b35a-6338a522e924]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd, portal: 172.16.0.220,3260]
Aug 16 10:37:24 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd, portal: 172.16.0.220,3260] successful.
Aug 16 10:37:24 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e979bb97-6f7a-4f62-b7ea-7296f19ddd45]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a283c-a646-4d18-b845-392c4e60a66c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:37:24 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)
Aug 16 10:37:24 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:37:24 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[35557a64-05e6-42f4-bbdd-ec108d8f64be]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:24 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:37:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:25 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:37:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJWAqkLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:37:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:37:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26663313164336436', 'path': '/dev/sdf'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:37:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663313164336436', 'path': '/dev/sdf'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:37:25 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lazy-loading 'flavor' on Instance uuid 0f85b78e-78c3-4e5a-a33d-ace04474a737 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:37:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:37:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] COPY block job progress, current cursor: 130023424 final cursor: 1073741824 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:37:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] COPY block job progress, current cursor: 285212672 final cursor: 1073741824 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:37:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] COPY block job progress, current cursor: 449839104 final cursor: 1073741824 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:37:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] COPY block job progress, current cursor: 566231040 final cursor: 1073741824 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:37:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] COPY block job progress, current cursor: 726663168 final cursor: 1073741824 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:37:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] COPY block job progress, current cursor: 898629632 final cursor: 1073741824 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] COPY block job progress, current cursor: 1067450368 final cursor: 1073741824 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqpsCGmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:37:29 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:37:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e04671-ad80-4a56-8785-b4f816e02c1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcedbaf-3602-4138-8cfa-164a95a31648]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:30 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:30 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:30 user nova-compute[73067]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)
Aug 16 10:37:30 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:37:30 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:30 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:30 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:30 user nova-compute[73067]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a (non-flash)
Aug 16 10:37:30 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:37:30 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35936e7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a'): ({'sde'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Removing single pathed devices sde {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5779d660-dbd5-4edb-b5da-19e55019edd2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[51253ecd-193a-4ee9-93fb-517aa0afc622]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Flushing IO for device /dev/sde {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d4b7f0-f9c1-4711-a480-bb02be9a9544]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa9112a-6de3-4c8b-9acf-1e2589ecc116]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] SCSI volumes sde have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17a6cff-fd59-4e1e-b5f3-bf8c78532344]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c6e99e-a4a1-4ea9-a28a-589b986a0f4a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a, portal: 172.16.0.220,3260]
Aug 16 10:37:30 user nova-compute[73067]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a, portal: 172.16.0.220,3260] successful.
Aug 16 10:37:30 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ddc6a-1646-49e3-b75b-06550fe90ffe]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] <== disconnect_volume: return (304ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJWAqkLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0f85b78e-78c3-4e5a-a33d-ace04474a737', 'attached_at': '', 'detached_at': '', 'volume_id': '0368e3e4-ecb6-4f51-afa1-19159cdb99fd', 'serial'} {{(pid=73067) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 10:37:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] swap_volume: removing Cinder connection for volume fd70f018-123d-4e2f-b21e-7d018b36be6a {{(pid=73067) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 10:37:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:37:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:37:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] swap_volume: Updating volume fd70f018-123d-4e2f-b21e-7d018b36be6a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "rJWAqkLP", "auth_password": "yOA2EV8UBwtWmR", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "0368e3e4-ecb6-4f51-afa1-19159cdb99fd"}, "status": "reserved", "instance": "0f85b78e-78c3-4e5a-a33d-ace04474a737", "attached_at": "", "detached_at": "", "volume_id": "0368e3e4-ecb6-4f51-afa1-19159cdb99fd", "serial": "0368e3e4-ecb6-4f51-afa1-19159cdb99fd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0368e3e4-ecb6-4f51-afa1-19159cdb99fd', 'no_device': None, 'attachment_id': '5a4a5313-597d-4513-b636-47dd96c63009'} {{(pid=73067) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 10:37:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d07f4631-6fbd-4c28-b989-e1c28543bccc tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 22.176s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:37:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:37:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:37:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updating instance_info_cache with network_info: [{"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG os_brick.utils [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2980ce6-7f8e-4f40-99cb-1edd09a480fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cbf7cb-451f-412b-8a8a-7ec28151da39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d589cd-646c-438a-b9af-8f887d1c9f66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e9b84f-b996-4a0e-a927-87a463656bec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:37:32 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89dc9ca-e2e2-4d94-94e8-d5522a8d1ea6]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG os_brick.utils [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:32 user nova-compute[73067]: INFO nova.compute.manager [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Swapping volume 0368e3e4-ecb6-4f51-afa1-19159cdb99fd for fd70f018-123d-4e2f-b21e-7d018b36be6a
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-723c78c2-ca05-43b2-963f-dc3fb83b49b7 req-7c91963c-1ea0-4aa4-887a-c77758138657 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received event network-changed-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-723c78c2-ca05-43b2-963f-dc3fb83b49b7 req-7c91963c-1ea0-4aa4-887a-c77758138657 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Refreshing instance network info cache due to event network-changed-0e377513-686a-458a-b39d-95cd3b041864. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-723c78c2-ca05-43b2-963f-dc3fb83b49b7 req-7c91963c-1ea0-4aa4-887a-c77758138657 service nova] Acquiring lock "refresh_cache-bc035e99-1a53-43df-8946-9c86ce2ecb0b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-723c78c2-ca05-43b2-963f-dc3fb83b49b7 req-7c91963c-1ea0-4aa4-887a-c77758138657 service nova] Acquired lock "refresh_cache-bc035e99-1a53-43df-8946-9c86ce2ecb0b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-723c78c2-ca05-43b2-963f-dc3fb83b49b7 req-7c91963c-1ea0-4aa4-887a-c77758138657 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Refreshing network info cache for port 0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'flavor' on Instance uuid bc035e99-1a53-43df-8946-9c86ce2ecb0b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Ignoring supplied device name: /dev/vdb
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.265s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-723c78c2-ca05-43b2-963f-dc3fb83b49b7 req-7c91963c-1ea0-4aa4-887a-c77758138657 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Updated VIF entry in instance network info cache for port 0e377513-686a-458a-b39d-95cd3b041864. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-723c78c2-ca05-43b2-963f-dc3fb83b49b7 req-7c91963c-1ea0-4aa4-887a-c77758138657 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Updating instance_info_cache with network_info: [{"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-723c78c2-ca05-43b2-963f-dc3fb83b49b7 req-7c91963c-1ea0-4aa4-887a-c77758138657 service nova] Releasing lock "refresh_cache-bc035e99-1a53-43df-8946-9c86ce2ecb0b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:33 user nova-compute[73067]: INFO nova.compute.manager [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Attaching volume f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d to /dev/vdb
Aug 16 10:37:33 user nova-compute[73067]: DEBUG os_brick.utils [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c16340-1156-44e1-b16a-d3b3cb17de16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[519c1e4c-dec9-47a1-beae-ab3703c93bb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82b975e-d482-4d0d-86a9-6c554980e8dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2375e1c-2500-4873-9f83-a6f640f0e4a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:37:33 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[77db1025-32a1-4afa-87e4-0a352529fcc7]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG os_brick.utils [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Updating existing volume attachment record: 8710cfe3-ca16-4db9-b023-443cec6161ff {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:37:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:37:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:36 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:37:36 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7190MB free_disk=25.424358367919922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b51879a0-d5a1-4f96-b0c1-0672d31e80db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ffe1f07d-0a48-431d-be98-7e78018faa10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6a791852-6268-4679-8b8f-e86eac3d5ad4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fcb6379a-4c57-462b-a4ea-9680340a5137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0f85b78e-78c3-4e5a-a33d-ace04474a737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance bc035e99-1a53-43df-8946-9c86ce2ecb0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 74a885f5-8405-444e-a620-ddd0ef0d1641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:37:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:37 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:37:37 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:37:37 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:37:37 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:37:37 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:37:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:39 user nova-compute[73067]: INFO nova.compute.manager [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Terminating instance
Aug 16 10:37:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-2219a5cd-5f9f-40e4-b88e-f8f92a5f5954 req-ba8007d5-80c9-4b3b-afa1-c970fa306e23 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-vif-unplugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2219a5cd-5f9f-40e4-b88e-f8f92a5f5954 req-ba8007d5-80c9-4b3b-afa1-c970fa306e23 service nova] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2219a5cd-5f9f-40e4-b88e-f8f92a5f5954 req-ba8007d5-80c9-4b3b-afa1-c970fa306e23 service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2219a5cd-5f9f-40e4-b88e-f8f92a5f5954 req-ba8007d5-80c9-4b3b-afa1-c970fa306e23 service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-2219a5cd-5f9f-40e4-b88e-f8f92a5f5954 req-ba8007d5-80c9-4b3b-afa1-c970fa306e23 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] No waiting events found dispatching network-vif-unplugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:37:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-2219a5cd-5f9f-40e4-b88e-f8f92a5f5954 req-ba8007d5-80c9-4b3b-afa1-c970fa306e23 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-vif-unplugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:40 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Instance destroyed successfully.
Aug 16 10:37:40 user nova-compute[73067]: DEBUG nova.objects.instance [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lazy-loading 'resources' on Instance uuid 6a791852-6268-4679-8b8f-e86eac3d5ad4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1260743046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1270920761',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh0HAwQTZopjSQvK4nRNzkmupgLc79gEeAnD6JiXUo09M1Aow2M59+WM4PCI/pkDjFgU58/V8/dsPWTgCy06otTlpj2gcZiXpmpK3PlioaPiBZfU7RdCLMYdPEz4NhR+Q==',key_name='tempest-keypair-263281918',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:36:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ab3b5056f7f40b79a779c06def8f966',ramdisk_id='',reservation_id='r-eijqx0a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-327151388',owner_user_name='tempest-ServerActionsV293TestJSON-327151388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:36:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a82f0b5e6de4d459a9f474ca9eef0a3',uuid=6a791852-6268-4679-8b8f-e86eac3d5ad4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converting VIF {"id": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "address": "fa:16:3e:cc:72:90", "network": {"id": "6498ea35-927f-4122-bf2e-a317a22a538e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1606898565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ab3b5056f7f40b79a779c06def8f966", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a42b863-50", "ovs_interfaceid": "2a42b863-50bb-4a5e-acbe-69b57ef321d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_vif [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a42b863-50, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:37:40 user nova-compute[73067]: INFO os_vif [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:72:90,bridge_name='br-int',has_traffic_filtering=True,id=2a42b863-50bb-4a5e-acbe-69b57ef321d0,network=Network(6498ea35-927f-4122-bf2e-a317a22a538e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a42b863-50')
Aug 16 10:37:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNflELXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:37:40 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef8e898-1297-4f0a-ac9c-35b9bc871cd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bf1429-64f2-4186-b7a2-a9838cda8918]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:40 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:40 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:40 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:37:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:40 user nova-compute[73067]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b (non-flash)
Aug 16 10:37:40 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:40 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:37:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3593782c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[059685ee-9a07-4d58-9ad3-97b054aded61]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d6c1cd-cc58-4847-b99e-28c78599af7d]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dec181-4d76-4bfb-bee4-4ac50f8634ca]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ece81-4575-4841-ae6d-b264668d488b]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bcc042-eda4-4a12-a8de-194fa732d822]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca369a1b-fec7-4e06-a2f1-367c00935cee]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260]
Aug 16 10:37:40 user nova-compute[73067]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b, portal: 172.16.0.220,3260] successful.
Aug 16 10:37:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a686d4-40fc-4a80-ad69-bde8fe90007f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] <== disconnect_volume: return (334ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:37:40 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Deleting instance files /opt/stack/data/nova/instances/6a791852-6268-4679-8b8f-e86eac3d5ad4_del
Aug 16 10:37:40 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Deletion of /opt/stack/data/nova/instances/6a791852-6268-4679-8b8f-e86eac3d5ad4_del complete
Aug 16 10:37:40 user nova-compute[73067]: INFO nova.compute.manager [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 16 10:37:40 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:37:40 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:37:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-79dc1c8f-2c7a-4935-a209-a429548f2707 req-4b22a747-1983-4ea5-b549-6c3935c04b68 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79dc1c8f-2c7a-4935-a209-a429548f2707 req-4b22a747-1983-4ea5-b549-6c3935c04b68 service nova] Acquiring lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79dc1c8f-2c7a-4935-a209-a429548f2707 req-4b22a747-1983-4ea5-b549-6c3935c04b68 service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79dc1c8f-2c7a-4935-a209-a429548f2707 req-4b22a747-1983-4ea5-b549-6c3935c04b68 service nova] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-79dc1c8f-2c7a-4935-a209-a429548f2707 req-4b22a747-1983-4ea5-b549-6c3935c04b68 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] No waiting events found dispatching network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:37:41 user nova-compute[73067]: WARNING nova.compute.manager [req-79dc1c8f-2c7a-4935-a209-a429548f2707 req-4b22a747-1983-4ea5-b549-6c3935c04b68 service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received unexpected event network-vif-plugged-2a42b863-50bb-4a5e-acbe-69b57ef321d0 for instance with vm_state active and task_state deleting.
Aug 16 10:37:42 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:37:42 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Took 1.32 seconds to deallocate network for instance.
Aug 16 10:37:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-c99ddcab-a091-4b14-9cad-caf4c60631c9 req-bea7996c-a89b-4cd3-bd3b-9f294168408b service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Received event network-vif-deleted-2a42b863-50bb-4a5e-acbe-69b57ef321d0 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:42 user nova-compute[73067]: INFO nova.compute.manager [req-c99ddcab-a091-4b14-9cad-caf4c60631c9 req-bea7996c-a89b-4cd3-bd3b-9f294168408b service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Neutron deleted interface 2a42b863-50bb-4a5e-acbe-69b57ef321d0; detaching it from the instance and deleting it from the info cache
Aug 16 10:37:42 user nova-compute[73067]: DEBUG nova.network.neutron [req-c99ddcab-a091-4b14-9cad-caf4c60631c9 req-bea7996c-a89b-4cd3-bd3b-9f294168408b service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:37:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-c99ddcab-a091-4b14-9cad-caf4c60631c9 req-bea7996c-a89b-4cd3-bd3b-9f294168408b service nova] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Detach interface failed, port_id=2a42b863-50bb-4a5e-acbe-69b57ef321d0, reason: Instance 6a791852-6268-4679-8b8f-e86eac3d5ad4 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:37:42 user nova-compute[73067]: INFO nova.compute.manager [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Took 0.87 seconds to detach 1 volumes for instance.
Aug 16 10:37:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Deleting volume: 999ca751-8c68-4f24-b23a-8b5d0dca292b {{(pid=73067) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 10:37:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.volume.cinder [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Update attachment failed for attachment 1be823a4-797c-4456-b4a4-a313d17eb97a. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b was not found.).). (HTTP 500) (Request-ID: req-48937c00-216d-4679-b4f6-8db97eba05ee) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b was not found.).). (HTTP 500) (Request-ID: req-48937c00-216d-4679-b4f6-8db97eba05ee)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Failed to connect to volume fd70f018-123d-4e2f-b21e-7d018b36be6a with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b was not found.).). (HTTP 500) (Request-ID: req-48937c00-216d-4679-b4f6-8db97eba05ee)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Traceback (most recent call last):
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     new_cinfo = self.volume_api.attachment_update(
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     res = method(self, ctx, *args, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     with excutils.save_and_reraise_exception():
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     self.force_reraise()
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     raise self.value
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     return method.func(obj, *args, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     resp = self._update('/attachments/%s' % id, body)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     return self.request(url, method, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737]     raise exceptions.from_response(resp, body)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b was not found.).). (HTTP 500) (Request-ID: req-48937c00-216d-4679-b4f6-8db97eba05ee)
Aug 16 10:37:43 user nova-compute[73067]: ERROR nova.compute.manager [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] 
Aug 16 10:37:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.302s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server [None req-634aeab9-1e8b-4ce7-ba17-4ff52e7c596a tempest-TestVolumeSwap-1127707772 tempest-TestVolumeSwap-1127707772-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b was not found.).). (HTTP 500) (Request-ID: req-48937c00-216d-4679-b4f6-8db97eba05ee)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7823, in swap_volume
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7821, in _do_locked_swap_volume
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7865, in _do_swap_volume
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7714, in _swap_volume
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fd70f018-123d-4e2f-b21e-7d018b36be6a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:999ca751-8c68-4f24-b23a-8b5d0dca292b was not found.).). (HTTP 500) (Request-ID: req-48937c00-216d-4679-b4f6-8db97eba05ee)
Aug 16 10:37:43 user nova-compute[73067]: ERROR oslo_messaging.rpc.server 
Aug 16 10:37:43 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:37:43 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:37:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:43 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Deleted allocations for instance 6a791852-6268-4679-8b8f-e86eac3d5ad4
Aug 16 10:37:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-06436480-4665-43fa-9f69-9600d80eb77e tempest-ServerActionsV293TestJSON-327151388 tempest-ServerActionsV293TestJSON-327151388-project-member] Lock "6a791852-6268-4679-8b8f-e86eac3d5ad4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.476s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "57c883ce-680f-455e-b393-e8c82576d440" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:46 user nova-compute[73067]: DEBUG nova.compute.manager [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:37:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:37:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:37:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:37:46 user nova-compute[73067]: INFO nova.compute.claims [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Claim successful on node user
Aug 16 10:37:47 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:37:47 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:37:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:37:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:37:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:37:47 user nova-compute[73067]: DEBUG nova.network.neutron [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:37:47 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:37:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:37:47 user nova-compute[73067]: INFO nova.virt.block_device [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Booting with blank volume at /dev/vda
Aug 16 10:37:47 user nova-compute[73067]: DEBUG nova.policy [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b135edcf064595b8d93052903696a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03e64450654fd693d6a1bd43017880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:37:47 user nova-compute[73067]: DEBUG nova.network.neutron [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Successfully created port: 75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:37:48 user nova-compute[73067]: DEBUG nova.network.neutron [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Successfully updated port: 75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:37:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:37:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquired lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:37:48 user nova-compute[73067]: DEBUG nova.network.neutron [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:37:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-6533fc1d-8b3c-4cef-ab67-1e63d675186b req-bfdc936e-c044-4555-ac61-53c903e41947 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-changed-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:37:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-6533fc1d-8b3c-4cef-ab67-1e63d675186b req-bfdc936e-c044-4555-ac61-53c903e41947 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Refreshing instance network info cache due to event network-changed-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:37:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6533fc1d-8b3c-4cef-ab67-1e63d675186b req-bfdc936e-c044-4555-ac61-53c903e41947 service nova] Acquiring lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:37:48 user nova-compute[73067]: DEBUG nova.network.neutron [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:37:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updating instance_info_cache with network_info: [{"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:37:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Releasing lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:37:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Instance network_info: |[{"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:37:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6533fc1d-8b3c-4cef-ab67-1e63d675186b req-bfdc936e-c044-4555-ac61-53c903e41947 service nova] Acquired lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:37:49 user nova-compute[73067]: DEBUG nova.network.neutron [req-6533fc1d-8b3c-4cef-ab67-1e63d675186b req-bfdc936e-c044-4555-ac61-53c903e41947 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Refreshing network info cache for port 75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:37:49 user nova-compute[73067]: DEBUG nova.network.neutron [req-6533fc1d-8b3c-4cef-ab67-1e63d675186b req-bfdc936e-c044-4555-ac61-53c903e41947 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updated VIF entry in instance network info cache for port 75d617b8-2a0f-40a6-9ac3-b22d3ce779f6. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:37:49 user nova-compute[73067]: DEBUG nova.network.neutron [req-6533fc1d-8b3c-4cef-ab67-1e63d675186b req-bfdc936e-c044-4555-ac61-53c903e41947 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updating instance_info_cache with network_info: [{"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:37:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6533fc1d-8b3c-4cef-ab67-1e63d675186b req-bfdc936e-c044-4555-ac61-53c903e41947 service nova] Releasing lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:37:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:37:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG os_brick.utils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b914aa2b-5e6c-47af-9d0a-e914123c7eaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[744edd67-2405-4c56-aa17-4085e3835c58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0217535c-fa2f-4722-9423-a2825a4d2041]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55ecd2a-776f-4d9a-8b9b-bbafe8729993]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:37:52 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:37:52 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e73684-5f7a-4508-9c76-cb3f9e2d9fd5]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.utils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updating existing volume attachment record: da703fe9-0991-4e95-9414-d6402693dc9d {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEbfFKZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:37:53 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:37:53 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:37:53 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da35b62-eca4-47eb-aa51-2199347329ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:37:53 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8cb72c-251c-41c0-bd92-50846af771ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d] added
Aug 16 10:37:53 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[151cd4a9-eac5-403c-ad05-f9afe155939d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53330c4-5678-4ff0-8634-7edecb3fc9a9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEbfFKZG {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEbfFKZG" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[910507c6-95e4-4cd1-a4da-3b95564fe6f0]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DEbfFKZG'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc8c19e-34f4-4099-88da-77be61b73f9e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc74e3c-dea4-4ea7-9875-97bb882b16b5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:53 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:53 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:37:53 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:53 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:53 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:37:53 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[af977fef-0a13-4c33-98cd-af495300e307]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d, portal: 172.16.0.220,3260]
Aug 16 10:37:53 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d, portal: 172.16.0.220,3260] successful.
Aug 16 10:37:53 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f534791d-0779-49ba-b19b-9f09e2e4f846]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:37:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ec6176-e95f-4370-a6bc-edd116d85c8c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:54 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:54 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:37:54 user nova-compute[73067]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)
Aug 16 10:37:54 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:37:54 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:37:54 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:37:54 user nova-compute[73067]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)
Aug 16 10:37:54 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee73e54-25af-4d31-86aa-3cf63f0d0db0]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:37:54 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEbfFKZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26532376363663239', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532376363663239', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'flavor' on Instance uuid bc035e99-1a53-43df-8946-9c86ce2ecb0b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:37:55 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:37:55 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:37:55 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:37:55 user nova-compute[73067]:   <serial>f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d</serial>
Aug 16 10:37:55 user nova-compute[73067]: </disk>
Aug 16 10:37:55 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182260.2939408, 6a791852-6268-4679-8b8f-e86eac3d5ad4 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:37:55 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] VM Stopped (Lifecycle Event)
Aug 16 10:37:55 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9304bc9d-4e89-432c-8d5d-aabcce9f9217 None None] [instance: 6a791852-6268-4679-8b8f-e86eac3d5ad4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] No VIF found with MAC fa:16:3e:b7:ad:bb, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:37:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9044bd26-9bbb-49ac-bae5-61b14e9b792b tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.257s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:38:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:38:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:38:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:38:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:38:04 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Creating image(s)
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Ensure instance console log exists: /opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Start _get_guest_xml network_info=[{"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAPiGquj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '57c883ce-680f-455e-b393-e8c82576d440', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7b0ebfb-7ee6-46a6-8356-82d777e8a742', 'serial': 'b7b0ebfb-7ee6-46a6-8356-82d777e8a742'}, 'delete_on_termination': False, 'attachment_id': 'da703fe9-0991-4e95-9414-d6402693dc9d', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:38:04 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:04 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAPiGquj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:38:04 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:38:04 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:38:04 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce4459-cf30-4299-9ed9-2fb457326758]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:38:04 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cbe556-096c-4fd8-b8c4-14ca0ba84582]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742] added
Aug 16 10:38:04 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c7158c-d6bb-4ac0-9a6a-cefbe4ef60ee]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b05321-2195-4274-b1e6-c60d3464b982]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAPiGquj {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAPiGquj" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f85ef4-3c2e-43b1-9595-65ca91ea39d4]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OAPiGquj'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[38441400-a3d8-408f-967b-22fc27ae60ea]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9adee0c-6f2e-4772-8186-54e225efc0d0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)
Aug 16 10:38:04 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)
Aug 16 10:38:04 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[edafda07-ddf4-4c2b-91da-6e947df7e5c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742, portal: 172.16.0.220,3260]
Aug 16 10:38:04 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742, portal: 172.16.0.220,3260] successful.
Aug 16 10:38:04 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcc5adb-00e6-4877-8fcd-717967eb5660]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[158e68ee-543c-472a-b538-d5c0c3d58999]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:38:04 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)
Aug 16 10:38:04 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:38:04 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[372a73cd-13f5-401a-87bc-77b2b5bae2e4]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:04 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:38:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:05 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:38:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAPiGquj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:38:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:38:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23266616234333063', 'path': '/dev/sde'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:38:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266616234333063', 'path': '/dev/sde'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:38:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1809056316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1809056316',id=24,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-ogv2vdn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:37:47Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=57c883ce-680f-455e-b393-e8c82576d440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:38:05 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:05 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=75d617b8-2a0f-40a6-9ac3-b22d3ce779f6,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d617b8-2a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:05 user nova-compute[73067]: DEBUG nova.objects.instance [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'pci_devices' on Instance uuid 57c883ce-680f-455e-b393-e8c82576d440 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:38:06 user nova-compute[73067]:   <uuid>57c883ce-680f-455e-b393-e8c82576d440</uuid>
Aug 16 10:38:06 user nova-compute[73067]:   <name>instance-00000018</name>
Aug 16 10:38:06 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:38:06 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:38:06 user nova-compute[73067]:   <metadata>
Aug 16 10:38:06 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:38:06 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:38:06 user nova-compute[73067]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1809056316</nova:name>
Aug 16 10:38:06 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:38:04</nova:creationTime>
Aug 16 10:38:06 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:38:06 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:38:06 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:38:06 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:38:06 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:38:06 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:38:06 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:38:06 user nova-compute[73067]:       <nova:owner>
Aug 16 10:38:06 user nova-compute[73067]:         <nova:user uuid="d3b135edcf064595b8d93052903696a7">tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member</nova:user>
Aug 16 10:38:06 user nova-compute[73067]:         <nova:project uuid="4d03e64450654fd693d6a1bd43017880">tempest-ServerBootFromVolumeStableRescueTest-1973630968</nova:project>
Aug 16 10:38:06 user nova-compute[73067]:       </nova:owner>
Aug 16 10:38:06 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:38:06 user nova-compute[73067]:       <nova:ports>
Aug 16 10:38:06 user nova-compute[73067]:         <nova:port uuid="75d617b8-2a0f-40a6-9ac3-b22d3ce779f6">
Aug 16 10:38:06 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 10:38:06 user nova-compute[73067]:         </nova:port>
Aug 16 10:38:06 user nova-compute[73067]:       </nova:ports>
Aug 16 10:38:06 user nova-compute[73067]:     </nova:instance>
Aug 16 10:38:06 user nova-compute[73067]:   </metadata>
Aug 16 10:38:06 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:38:06 user nova-compute[73067]:     <system>
Aug 16 10:38:06 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:38:06 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:38:06 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:38:06 user nova-compute[73067]:       <entry name="serial">57c883ce-680f-455e-b393-e8c82576d440</entry>
Aug 16 10:38:06 user nova-compute[73067]:       <entry name="uuid">57c883ce-680f-455e-b393-e8c82576d440</entry>
Aug 16 10:38:06 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:38:06 user nova-compute[73067]:     </system>
Aug 16 10:38:06 user nova-compute[73067]:   </sysinfo>
Aug 16 10:38:06 user nova-compute[73067]:   <os>
Aug 16 10:38:06 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:38:06 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:38:06 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:38:06 user nova-compute[73067]:   </os>
Aug 16 10:38:06 user nova-compute[73067]:   <features>
Aug 16 10:38:06 user nova-compute[73067]:     <acpi/>
Aug 16 10:38:06 user nova-compute[73067]:     <apic/>
Aug 16 10:38:06 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:38:06 user nova-compute[73067]:   </features>
Aug 16 10:38:06 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:38:06 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:38:06 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:38:06 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:38:06 user nova-compute[73067]:   </clock>
Aug 16 10:38:06 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:38:06 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:38:06 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:38:06 user nova-compute[73067]:   </cpu>
Aug 16 10:38:06 user nova-compute[73067]:   <devices>
Aug 16 10:38:06 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:38:06 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:38:06 user nova-compute[73067]:       <source dev="/dev/sde"/>
Aug 16 10:38:06 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:38:06 user nova-compute[73067]:       <serial>b7b0ebfb-7ee6-46a6-8356-82d777e8a742</serial>
Aug 16 10:38:06 user nova-compute[73067]:     </disk>
Aug 16 10:38:06 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:38:06 user nova-compute[73067]:       <mac address="fa:16:3e:49:19:c4"/>
Aug 16 10:38:06 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:38:06 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:38:06 user nova-compute[73067]:       <target dev="tap75d617b8-2a"/>
Aug 16 10:38:06 user nova-compute[73067]:     </interface>
Aug 16 10:38:06 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:38:06 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/console.log" append="off"/>
Aug 16 10:38:06 user nova-compute[73067]:     </serial>
Aug 16 10:38:06 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:38:06 user nova-compute[73067]:     <video>
Aug 16 10:38:06 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:38:06 user nova-compute[73067]:     </video>
Aug 16 10:38:06 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:38:06 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:38:06 user nova-compute[73067]:     </rng>
Aug 16 10:38:06 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:38:06 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:38:06 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:38:06 user nova-compute[73067]:     </memballoon>
Aug 16 10:38:06 user nova-compute[73067]:   </devices>
Aug 16 10:38:06 user nova-compute[73067]: </domain>
Aug 16 10:38:06 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1809056316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1809056316',id=24,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-ogv2vdn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:37:47Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=57c883ce-680f-455e-b393-e8c82576d440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=75d617b8-2a0f-40a6-9ac3-b22d3ce779f6,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d617b8-2a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG os_vif [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=75d617b8-2a0f-40a6-9ac3-b22d3ce779f6,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d617b8-2a') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75d617b8-2a, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75d617b8-2a, col_values=(('external_ids', {'iface-id': '75d617b8-2a0f-40a6-9ac3-b22d3ce779f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:19:c4', 'vm-uuid': '57c883ce-680f-455e-b393-e8c82576d440'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:06 user nova-compute[73067]: INFO os_vif [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=75d617b8-2a0f-40a6-9ac3-b22d3ce779f6,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d617b8-2a')
Aug 16 10:38:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No VIF found with MAC fa:16:3e:49:19:c4, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:38:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:07 user nova-compute[73067]: DEBUG nova.compute.manager [req-16ee350b-a0f1-4485-b089-9d7a98f248df req-a826ba39-f130-4150-b148-75a7cc27d485 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16ee350b-a0f1-4485-b089-9d7a98f248df req-a826ba39-f130-4150-b148-75a7cc27d485 service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16ee350b-a0f1-4485-b089-9d7a98f248df req-a826ba39-f130-4150-b148-75a7cc27d485 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-16ee350b-a0f1-4485-b089-9d7a98f248df req-a826ba39-f130-4150-b148-75a7cc27d485 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:07 user nova-compute[73067]: DEBUG nova.compute.manager [req-16ee350b-a0f1-4485-b089-9d7a98f248df req-a826ba39-f130-4150-b148-75a7cc27d485 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:07 user nova-compute[73067]: WARNING nova.compute.manager [req-16ee350b-a0f1-4485-b089-9d7a98f248df req-a826ba39-f130-4150-b148-75a7cc27d485 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state building and task_state spawning.
Aug 16 10:38:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182289.5960188, 57c883ce-680f-455e-b393-e8c82576d440 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] VM Resumed (Lifecycle Event)
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:38:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Instance spawned successfully.
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:38:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182289.6001437, 57c883ce-680f-455e-b393-e8c82576d440 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] VM Started (Lifecycle Event)
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-f067c047-23c9-42a8-ae29-65cbf54a6d10 req-33ac48bb-4153-4c19-817b-d471f6c60086 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f067c047-23c9-42a8-ae29-65cbf54a6d10 req-33ac48bb-4153-4c19-817b-d471f6c60086 service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f067c047-23c9-42a8-ae29-65cbf54a6d10 req-33ac48bb-4153-4c19-817b-d471f6c60086 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f067c047-23c9-42a8-ae29-65cbf54a6d10 req-33ac48bb-4153-4c19-817b-d471f6c60086 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-f067c047-23c9-42a8-ae29-65cbf54a6d10 req-33ac48bb-4153-4c19-817b-d471f6c60086 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:09 user nova-compute[73067]: WARNING nova.compute.manager [req-f067c047-23c9-42a8-ae29-65cbf54a6d10 req-33ac48bb-4153-4c19-817b-d471f6c60086 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state building and task_state spawning.
Aug 16 10:38:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:38:09 user nova-compute[73067]: INFO nova.compute.manager [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Took 5.32 seconds to spawn the instance on the hypervisor.
Aug 16 10:38:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:09 user nova-compute[73067]: INFO nova.compute.manager [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Took 23.23 seconds to build instance.
Aug 16 10:38:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-eaaa7812-5c50-4a58-a8dc-c043ea48c273 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "57c883ce-680f-455e-b393-e8c82576d440" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.325s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:38:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:15 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:38:15 user nova-compute[73067]: INFO nova.compute.claims [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Claim successful on node user
Aug 16 10:38:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG nova.network.neutron [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:38:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:38:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG nova.policy [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '220084fddd114ff989a0603bdb98df76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1390d54176cf46679a1d44d85aa20ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:38:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Creating image(s)
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "/opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "/opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.207s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk 1073741824" returned: 0 in 0.070s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.199s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG nova.network.neutron [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Successfully created port: 9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Cannot resize image /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG nova.objects.instance [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'migration_context' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Ensure instance console log exists: /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.network.neutron [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Successfully updated port: 9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquired lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.network.neutron [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-5b7bfeba-e28a-43e0-9c4b-88b47a786960 req-2c47937b-0237-4395-8541-ebf771595f8f service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-changed-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-5b7bfeba-e28a-43e0-9c4b-88b47a786960 req-2c47937b-0237-4395-8541-ebf771595f8f service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Refreshing instance network info cache due to event network-changed-9aec1f71-9229-4e37-b633-b2204d7a4484. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5b7bfeba-e28a-43e0-9c4b-88b47a786960 req-2c47937b-0237-4395-8541-ebf771595f8f service nova] Acquiring lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.network.neutron [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:38:18 user nova-compute[73067]: INFO nova.compute.manager [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] instance snapshotting
Aug 16 10:38:18 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Beginning live snapshot process
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json -f qcow2 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.network.neutron [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updating instance_info_cache with network_info: [{"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Releasing lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance network_info: |[{"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5b7bfeba-e28a-43e0-9c4b-88b47a786960 req-2c47937b-0237-4395-8541-ebf771595f8f service nova] Acquired lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-5b7bfeba-e28a-43e0-9c4b-88b47a786960 req-2c47937b-0237-4395-8541-ebf771595f8f service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Refreshing network info cache for port 9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Start _get_guest_xml network_info=[{"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:38:18 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:18 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1846221895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1846221895',id=25,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQLeVJ9+VvVaQoNonbC1P2yB/UFcdPrlEtelI4nMnb6bicCGLgiVAtuSX8tNWkXxMJWyAVCENVhakwG4a4lJBnM4M+Mek/Dn7aiiBJzoKdLv41kQKbVz5WyipYM4S5xyQ==',key_name='tempest-keypair-917872012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-hbj32uf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:38:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=4b3c2355-eee1-4a0f-bebc-9425ec85aac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.objects.instance [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:38:18 user nova-compute[73067]:   <uuid>4b3c2355-eee1-4a0f-bebc-9425ec85aac4</uuid>
Aug 16 10:38:18 user nova-compute[73067]:   <name>instance-00000019</name>
Aug 16 10:38:18 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:38:18 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:38:18 user nova-compute[73067]:   <metadata>
Aug 16 10:38:18 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:38:18 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:38:18 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1846221895</nova:name>
Aug 16 10:38:18 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:38:18</nova:creationTime>
Aug 16 10:38:18 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:38:18 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:38:18 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:38:18 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:38:18 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:38:18 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:38:18 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:38:18 user nova-compute[73067]:       <nova:owner>
Aug 16 10:38:18 user nova-compute[73067]:         <nova:user uuid="220084fddd114ff989a0603bdb98df76">tempest-AttachVolumeShelveTestJSON-295458602-project-member</nova:user>
Aug 16 10:38:18 user nova-compute[73067]:         <nova:project uuid="1390d54176cf46679a1d44d85aa20ba0">tempest-AttachVolumeShelveTestJSON-295458602</nova:project>
Aug 16 10:38:18 user nova-compute[73067]:       </nova:owner>
Aug 16 10:38:18 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:38:18 user nova-compute[73067]:       <nova:ports>
Aug 16 10:38:18 user nova-compute[73067]:         <nova:port uuid="9aec1f71-9229-4e37-b633-b2204d7a4484">
Aug 16 10:38:18 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 10:38:18 user nova-compute[73067]:         </nova:port>
Aug 16 10:38:18 user nova-compute[73067]:       </nova:ports>
Aug 16 10:38:18 user nova-compute[73067]:     </nova:instance>
Aug 16 10:38:18 user nova-compute[73067]:   </metadata>
Aug 16 10:38:18 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:38:18 user nova-compute[73067]:     <system>
Aug 16 10:38:18 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:38:18 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:38:18 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:38:18 user nova-compute[73067]:       <entry name="serial">4b3c2355-eee1-4a0f-bebc-9425ec85aac4</entry>
Aug 16 10:38:18 user nova-compute[73067]:       <entry name="uuid">4b3c2355-eee1-4a0f-bebc-9425ec85aac4</entry>
Aug 16 10:38:18 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:38:18 user nova-compute[73067]:     </system>
Aug 16 10:38:18 user nova-compute[73067]:   </sysinfo>
Aug 16 10:38:18 user nova-compute[73067]:   <os>
Aug 16 10:38:18 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:38:18 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:38:18 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:38:18 user nova-compute[73067]:   </os>
Aug 16 10:38:18 user nova-compute[73067]:   <features>
Aug 16 10:38:18 user nova-compute[73067]:     <acpi/>
Aug 16 10:38:18 user nova-compute[73067]:     <apic/>
Aug 16 10:38:18 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:38:18 user nova-compute[73067]:   </features>
Aug 16 10:38:18 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:38:18 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:38:18 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:38:18 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:38:18 user nova-compute[73067]:   </clock>
Aug 16 10:38:18 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:38:18 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:38:18 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:38:18 user nova-compute[73067]:   </cpu>
Aug 16 10:38:18 user nova-compute[73067]:   <devices>
Aug 16 10:38:18 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:38:18 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:38:18 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk"/>
Aug 16 10:38:18 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:38:18 user nova-compute[73067]:     </disk>
Aug 16 10:38:18 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:38:18 user nova-compute[73067]:       <mac address="fa:16:3e:41:d5:23"/>
Aug 16 10:38:18 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:38:18 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:38:18 user nova-compute[73067]:       <target dev="tap9aec1f71-92"/>
Aug 16 10:38:18 user nova-compute[73067]:     </interface>
Aug 16 10:38:18 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:38:18 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/console.log" append="off"/>
Aug 16 10:38:18 user nova-compute[73067]:     </serial>
Aug 16 10:38:18 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:38:18 user nova-compute[73067]:     <video>
Aug 16 10:38:18 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:38:18 user nova-compute[73067]:     </video>
Aug 16 10:38:18 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:38:18 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:38:18 user nova-compute[73067]:     </rng>
Aug 16 10:38:18 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:38:18 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:38:18 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:38:18 user nova-compute[73067]:     </memballoon>
Aug 16 10:38:18 user nova-compute[73067]:   </devices>
Aug 16 10:38:18 user nova-compute[73067]: </domain>
Aug 16 10:38:18 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1846221895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1846221895',id=25,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQLeVJ9+VvVaQoNonbC1P2yB/UFcdPrlEtelI4nMnb6bicCGLgiVAtuSX8tNWkXxMJWyAVCENVhakwG4a4lJBnM4M+Mek/Dn7aiiBJzoKdLv41kQKbVz5WyipYM4S5xyQ==',key_name='tempest-keypair-917872012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-hbj32uf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:38:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=4b3c2355-eee1-4a0f-bebc-9425ec85aac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG os_vif [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json -f qcow2 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9aec1f71-92, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9aec1f71-92, col_values=(('external_ids', {'iface-id': '9aec1f71-9229-4e37-b633-b2204d7a4484', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:d5:23', 'vm-uuid': '4b3c2355-eee1-4a0f-bebc-9425ec85aac4'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:18 user nova-compute[73067]: INFO os_vif [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92')
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] No VIF found with MAC fa:16:3e:41:d5:23, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpebzsrhr3/9675483d27554b19844f565d3bb5b5fe.delta 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:19 user nova-compute[73067]: DEBUG nova.network.neutron [req-5b7bfeba-e28a-43e0-9c4b-88b47a786960 req-2c47937b-0237-4395-8541-ebf771595f8f service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updated VIF entry in instance network info cache for port 9aec1f71-9229-4e37-b633-b2204d7a4484. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:38:19 user nova-compute[73067]: DEBUG nova.network.neutron [req-5b7bfeba-e28a-43e0-9c4b-88b47a786960 req-2c47937b-0237-4395-8541-ebf771595f8f service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updating instance_info_cache with network_info: [{"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpebzsrhr3/9675483d27554b19844f565d3bb5b5fe.delta 1073741824" returned: 0 in 0.111s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 10:38:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5b7bfeba-e28a-43e0-9c4b-88b47a786960 req-2c47937b-0237-4395-8541-ebf771595f8f service nova] Releasing lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:38:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:38:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] COPY block job progress, current cursor: 24641536 final cursor: 75563008 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:38:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-02d3a3ca-b32b-4d5f-a6a0-d66a88bdd9ec req-b83ebb57-9cea-4b01-a1aa-7b13594ec366 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-02d3a3ca-b32b-4d5f-a6a0-d66a88bdd9ec req-b83ebb57-9cea-4b01-a1aa-7b13594ec366 service nova] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-02d3a3ca-b32b-4d5f-a6a0-d66a88bdd9ec req-b83ebb57-9cea-4b01-a1aa-7b13594ec366 service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-02d3a3ca-b32b-4d5f-a6a0-d66a88bdd9ec req-b83ebb57-9cea-4b01-a1aa-7b13594ec366 service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-02d3a3ca-b32b-4d5f-a6a0-d66a88bdd9ec req-b83ebb57-9cea-4b01-a1aa-7b13594ec366 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] No waiting events found dispatching network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:21 user nova-compute[73067]: WARNING nova.compute.manager [req-02d3a3ca-b32b-4d5f-a6a0-d66a88bdd9ec req-b83ebb57-9cea-4b01-a1aa-7b13594ec366 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received unexpected event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 for instance with vm_state building and task_state spawning.
Aug 16 10:38:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:38:21 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 10:38:21 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:38:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpebzsrhr3/9675483d27554b19844f565d3bb5b5fe.delta /opt/stack/data/nova/instances/snapshots/tmpebzsrhr3/9675483d27554b19844f565d3bb5b5fe {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpebzsrhr3/9675483d27554b19844f565d3bb5b5fe.delta /opt/stack/data/nova/instances/snapshots/tmpebzsrhr3/9675483d27554b19844f565d3bb5b5fe" returned: 0 in 0.619s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Snapshot extracted, beginning image upload
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.compute.manager [req-129be0e3-8a26-4416-a8e5-345109dc3711 req-86a77893-2f1d-4da9-9d10-0871fda2c6c3 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-129be0e3-8a26-4416-a8e5-345109dc3711 req-86a77893-2f1d-4da9-9d10-0871fda2c6c3 service nova] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-129be0e3-8a26-4416-a8e5-345109dc3711 req-86a77893-2f1d-4da9-9d10-0871fda2c6c3 service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-129be0e3-8a26-4416-a8e5-345109dc3711 req-86a77893-2f1d-4da9-9d10-0871fda2c6c3 service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.compute.manager [req-129be0e3-8a26-4416-a8e5-345109dc3711 req-86a77893-2f1d-4da9-9d10-0871fda2c6c3 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] No waiting events found dispatching network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:23 user nova-compute[73067]: WARNING nova.compute.manager [req-129be0e3-8a26-4416-a8e5-345109dc3711 req-86a77893-2f1d-4da9-9d10-0871fda2c6c3 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received unexpected event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 for instance with vm_state building and task_state spawning.
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182303.4153726, 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:23 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] VM Resumed (Lifecycle Event)
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:38:23 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance spawned successfully.
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:23 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182303.416716, 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:23 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] VM Started (Lifecycle Event)
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:38:23 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:38:23 user nova-compute[73067]: INFO nova.compute.manager [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Took 7.15 seconds to spawn the instance on the hypervisor.
Aug 16 10:38:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:23 user nova-compute[73067]: INFO nova.compute.manager [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Took 8.16 seconds to build instance.
Aug 16 10:38:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-86edd304-fa11-470a-adf6-e873fcfc7a9c tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.269s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:24 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Snapshot image upload complete
Aug 16 10:38:24 user nova-compute[73067]: INFO nova.compute.manager [None req-c3d328bf-89c9-47e4-bdb3-c4cfa7b50940 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Took 6.78 seconds to snapshot the instance on the hypervisor.
Aug 16 10:38:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:38:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:38:27 user nova-compute[73067]: INFO nova.compute.claims [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Claim successful on node user
Aug 16 10:38:28 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG nova.network.neutron [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:38:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:38:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG nova.policy [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c07aeeaa3b248358386475d9cab6197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0867b7c5756147859834ccb143e32e83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:38:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Creating image(s)
Aug 16 10:38:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "/opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "/opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "2e2c0bc9b8f91b78080c354101aa3738cb275048" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "2e2c0bc9b8f91b78080c354101aa3738cb275048" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048.part --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:29 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:38:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048.part --force-share --output=json" returned: 0 in 0.262s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:30 user nova-compute[73067]: DEBUG nova.virt.images [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] 02170190-cbbe-4fb6-af54-cc2952e586b8 was qcow2, converting to raw {{(pid=73067) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 10:38:30 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:38:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048.part /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048.converted {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:30 user nova-compute[73067]: DEBUG nova.network.neutron [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Successfully created port: 428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:38:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048.part /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048.converted" returned: 0 in 0.617s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048.converted --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "2e2c0bc9b8f91b78080c354101aa3738cb275048" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.454s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048 --force-share --output=json" returned: 0 in 0.212s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "2e2c0bc9b8f91b78080c354101aa3738cb275048" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "2e2c0bc9b8f91b78080c354101aa3738cb275048" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048 --force-share --output=json" returned: 0 in 0.245s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048,backing_fmt=raw /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048,backing_fmt=raw /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk 1073741824" returned: 0 in 0.065s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "2e2c0bc9b8f91b78080c354101aa3738cb275048" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048 --force-share --output=json" returned: 0 in 0.209s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'migration_context' on Instance uuid 7f99c350-1c4e-47e8-884a-e821b6dd83bc {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Ensure instance console log exists: /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:31 user nova-compute[73067]: INFO nova.compute.manager [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Detaching volume ac2d0615-79f2-4f6d-9854-4857305ade6e
Aug 16 10:38:31 user nova-compute[73067]: INFO nova.virt.block_device [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Attempting to driver detach volume ac2d0615-79f2-4f6d-9854-4857305ade6e from mountpoint /dev/vdb
Aug 16 10:38:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Attempting to detach device vdb from instance ffe1f07d-0a48-431d-be98-7e78018faa10 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:38:31 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:38:31 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:38:31 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:38:31 user nova-compute[73067]:   <serial>ac2d0615-79f2-4f6d-9854-4857305ade6e</serial>
Aug 16 10:38:31 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 10:38:31 user nova-compute[73067]: </disk>
Aug 16 10:38:31 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:38:31 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully detached device vdb from instance ffe1f07d-0a48-431d-be98-7e78018faa10 from the persistent domain config.
Aug 16 10:38:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffe1f07d-0a48-431d-be98-7e78018faa10 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:38:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:38:31 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:38:31 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:38:31 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:38:31 user nova-compute[73067]:   <serial>ac2d0615-79f2-4f6d-9854-4857305ade6e</serial>
Aug 16 10:38:31 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 10:38:31 user nova-compute[73067]: </disk>
Aug 16 10:38:31 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182312.3312821, ffe1f07d-0a48-431d-be98-7e78018faa10 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:38:32 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully detached device vdb from instance ffe1f07d-0a48-431d-be98-7e78018faa10 from the live domain config.
Aug 16 10:38:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKBWkqOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:38:32 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[57012983-660e-4958-ae52-e49cdfb1dbc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f849f-4acc-4870-a7f4-b2aaf86f5930]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:38:32 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:38:32 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:38:32 user nova-compute[73067]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)
Aug 16 10:38:32 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:38:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e (non-flash)
Aug 16 10:38:32 user nova-compute[73067]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:38:32 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:38:32 user nova-compute[73067]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)
Aug 16 10:38:32 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:38:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642da440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[be841232-121c-4228-b64f-6207246d82d7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[44847ad7-2ed7-47f2-9636-6c8eae4e549e]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[900d25c4-8f87-4808-b22e-f8d51d0474d9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0080becd-35ba-45e2-80ae-794ffa850e58]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4f79c0-7b3c-4b99-a046-bb8f7602a5c9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8e5e07-8424-42c9-92ad-fded8eefd0cc]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260]
Aug 16 10:38:32 user nova-compute[73067]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e, portal: 172.16.0.220,3260] successful.
Aug 16 10:38:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2d0615-79f2-4f6d-9854-4857305ade6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[951bb3dd-c32b-49b0-8f66-e0f175787157]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== disconnect_volume: return (356ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:38:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Updating instance_info_cache with network_info: [{"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-ffe1f07d-0a48-431d-be98-7e78018faa10" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Successfully updated port: 428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquired lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-3b877cf3-ebf0-41a2-9433-424daaafd343 req-3dc4a7af-83ff-4a45-b970-c677a4c09f68 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received event network-changed-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-3b877cf3-ebf0-41a2-9433-424daaafd343 req-3dc4a7af-83ff-4a45-b970-c677a4c09f68 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Refreshing instance network info cache due to event network-changed-428c8372-75c3-4d2d-a626-41a1bc868f2f. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3b877cf3-ebf0-41a2-9433-424daaafd343 req-3dc4a7af-83ff-4a45-b970-c677a4c09f68 service nova] Acquiring lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'flavor' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-fc9e8945-a77a-4280-b81c-05c1236026e2 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.995s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Updating instance_info_cache with network_info: [{"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Releasing lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Instance network_info: |[{"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3b877cf3-ebf0-41a2-9433-424daaafd343 req-3dc4a7af-83ff-4a45-b970-c677a4c09f68 service nova] Acquired lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-3b877cf3-ebf0-41a2-9433-424daaafd343 req-3dc4a7af-83ff-4a45-b970-c677a4c09f68 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Refreshing network info cache for port 428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:38:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Start _get_guest_xml network_info=[{"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1536e94129f97d7dbcc0c8076bd64091',container_format='bare',created_at=2023-08-16T10:38:18Z,direct_url=<?>,disk_format='qcow2',id=02170190-cbbe-4fb6-af54-cc2952e586b8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-309680082',owner='0867b7c5756147859834ccb143e32e83',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T10:38:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '02170190-cbbe-4fb6-af54-cc2952e586b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:38:34 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:34 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1536e94129f97d7dbcc0c8076bd64091',container_format='bare',created_at=2023-08-16T10:38:18Z,direct_url=<?>,disk_format='qcow2',id=02170190-cbbe-4fb6-af54-cc2952e586b8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-309680082',owner='0867b7c5756147859834ccb143e32e83',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T10:38:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-24187425',display_name='tempest-TestStampPattern-server-24187425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-24187425',id=26,image_ref='02170190-cbbe-4fb6-af54-cc2952e586b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhzbKl1sw2z92eEIWjGNXUHNDN+YFEF4o3EjSp4os/3KmUko/NUObr7P/Lm/HSenjudyIwF5g3sozv6zWEvvQfItOK8+Iy7HLWvdjDnl1Gv1Fe+d7iktSOtMwmKR6EbRw==',key_name='tempest-TestStampPattern-1751724200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0867b7c5756147859834ccb143e32e83',ramdisk_id='',reservation_id='r-2enf8qbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fcb6379a-4c57-462b-a4ea-9680340a5137',image_min_disk='1',image_min_ram='0',image_owner_id='0867b7c5756147859834ccb143e32e83',image_owner_project_name='tempest-TestStampPattern-920566978',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-920566978-project-member',image_user_id='5c07aeeaa3b248358386475d9cab6197',network_allocated='True',owner_project_name='tempest-TestStampPattern-920566978',owner_user_name='tempest-TestStampPattern-920566978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:38:28Z,user_data=None,user_id='5c07aeeaa3b248358386475d9cab6197',uuid=7f99c350-1c4e-47e8-884a-e821b6dd83bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converting VIF {"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b2:5c,bridge_name='br-int',has_traffic_filtering=True,id=428c8372-75c3-4d2d-a626-41a1bc868f2f,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428c8372-75') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.objects.instance [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f99c350-1c4e-47e8-884a-e821b6dd83bc {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:38:34 user nova-compute[73067]:   <uuid>7f99c350-1c4e-47e8-884a-e821b6dd83bc</uuid>
Aug 16 10:38:34 user nova-compute[73067]:   <name>instance-0000001a</name>
Aug 16 10:38:34 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:38:34 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:38:34 user nova-compute[73067]:   <metadata>
Aug 16 10:38:34 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:38:34 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:38:34 user nova-compute[73067]:       <nova:name>tempest-TestStampPattern-server-24187425</nova:name>
Aug 16 10:38:34 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:38:34</nova:creationTime>
Aug 16 10:38:34 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:38:34 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:38:34 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:38:34 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:38:34 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:38:34 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:38:34 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:38:34 user nova-compute[73067]:       <nova:owner>
Aug 16 10:38:34 user nova-compute[73067]:         <nova:user uuid="5c07aeeaa3b248358386475d9cab6197">tempest-TestStampPattern-920566978-project-member</nova:user>
Aug 16 10:38:34 user nova-compute[73067]:         <nova:project uuid="0867b7c5756147859834ccb143e32e83">tempest-TestStampPattern-920566978</nova:project>
Aug 16 10:38:34 user nova-compute[73067]:       </nova:owner>
Aug 16 10:38:34 user nova-compute[73067]:       <nova:root type="image" uuid="02170190-cbbe-4fb6-af54-cc2952e586b8"/>
Aug 16 10:38:34 user nova-compute[73067]:       <nova:ports>
Aug 16 10:38:34 user nova-compute[73067]:         <nova:port uuid="428c8372-75c3-4d2d-a626-41a1bc868f2f">
Aug 16 10:38:34 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 10:38:34 user nova-compute[73067]:         </nova:port>
Aug 16 10:38:34 user nova-compute[73067]:       </nova:ports>
Aug 16 10:38:34 user nova-compute[73067]:     </nova:instance>
Aug 16 10:38:34 user nova-compute[73067]:   </metadata>
Aug 16 10:38:34 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:38:34 user nova-compute[73067]:     <system>
Aug 16 10:38:34 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:38:34 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:38:34 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:38:34 user nova-compute[73067]:       <entry name="serial">7f99c350-1c4e-47e8-884a-e821b6dd83bc</entry>
Aug 16 10:38:34 user nova-compute[73067]:       <entry name="uuid">7f99c350-1c4e-47e8-884a-e821b6dd83bc</entry>
Aug 16 10:38:34 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:38:34 user nova-compute[73067]:     </system>
Aug 16 10:38:34 user nova-compute[73067]:   </sysinfo>
Aug 16 10:38:34 user nova-compute[73067]:   <os>
Aug 16 10:38:34 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:38:34 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:38:34 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:38:34 user nova-compute[73067]:   </os>
Aug 16 10:38:34 user nova-compute[73067]:   <features>
Aug 16 10:38:34 user nova-compute[73067]:     <acpi/>
Aug 16 10:38:34 user nova-compute[73067]:     <apic/>
Aug 16 10:38:34 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:38:34 user nova-compute[73067]:   </features>
Aug 16 10:38:34 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:38:34 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:38:34 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:38:34 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:38:34 user nova-compute[73067]:   </clock>
Aug 16 10:38:34 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:38:34 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:38:34 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:38:34 user nova-compute[73067]:   </cpu>
Aug 16 10:38:34 user nova-compute[73067]:   <devices>
Aug 16 10:38:34 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:38:34 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:38:34 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk"/>
Aug 16 10:38:34 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:38:34 user nova-compute[73067]:     </disk>
Aug 16 10:38:34 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:38:34 user nova-compute[73067]:       <mac address="fa:16:3e:d5:b2:5c"/>
Aug 16 10:38:34 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:38:34 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:38:34 user nova-compute[73067]:       <target dev="tap428c8372-75"/>
Aug 16 10:38:34 user nova-compute[73067]:     </interface>
Aug 16 10:38:34 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:38:34 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/console.log" append="off"/>
Aug 16 10:38:34 user nova-compute[73067]:     </serial>
Aug 16 10:38:34 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:38:34 user nova-compute[73067]:     <video>
Aug 16 10:38:34 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:38:34 user nova-compute[73067]:     </video>
Aug 16 10:38:34 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:38:34 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:38:34 user nova-compute[73067]:     </rng>
Aug 16 10:38:34 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:38:34 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:38:34 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:38:34 user nova-compute[73067]:     </memballoon>
Aug 16 10:38:34 user nova-compute[73067]:   </devices>
Aug 16 10:38:34 user nova-compute[73067]: </domain>
Aug 16 10:38:34 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-24187425',display_name='tempest-TestStampPattern-server-24187425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-24187425',id=26,image_ref='02170190-cbbe-4fb6-af54-cc2952e586b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhzbKl1sw2z92eEIWjGNXUHNDN+YFEF4o3EjSp4os/3KmUko/NUObr7P/Lm/HSenjudyIwF5g3sozv6zWEvvQfItOK8+Iy7HLWvdjDnl1Gv1Fe+d7iktSOtMwmKR6EbRw==',key_name='tempest-TestStampPattern-1751724200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0867b7c5756147859834ccb143e32e83',ramdisk_id='',reservation_id='r-2enf8qbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fcb6379a-4c57-462b-a4ea-9680340a5137',image_min_disk='1',image_min_ram='0',image_owner_id='0867b7c5756147859834ccb143e32e83',image_owner_project_name='tempest-TestStampPattern-920566978',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-920566978-project-member',image_user_id='5c07aeeaa3b248358386475d9cab6197',network_allocated='True',owner_project_name='tempest-TestStampPattern-920566978',owner_user_name='tempest-TestStampPattern-920566978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:38:28Z,user_data=None,user_id='5c07aeeaa3b248358386475d9cab6197',uuid=7f99c350-1c4e-47e8-884a-e821b6dd83bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converting VIF {"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b2:5c,bridge_name='br-int',has_traffic_filtering=True,id=428c8372-75c3-4d2d-a626-41a1bc868f2f,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428c8372-75') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG os_vif [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b2:5c,bridge_name='br-int',has_traffic_filtering=True,id=428c8372-75c3-4d2d-a626-41a1bc868f2f,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428c8372-75') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap428c8372-75, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap428c8372-75, col_values=(('external_ids', {'iface-id': '428c8372-75c3-4d2d-a626-41a1bc868f2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:b2:5c', 'vm-uuid': '7f99c350-1c4e-47e8-884a-e821b6dd83bc'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:34 user nova-compute[73067]: INFO os_vif [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b2:5c,bridge_name='br-int',has_traffic_filtering=True,id=428c8372-75c3-4d2d-a626-41a1bc868f2f,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428c8372-75')
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] No VIF found with MAC fa:16:3e:d5:b2:5c, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.network.neutron [req-3b877cf3-ebf0-41a2-9433-424daaafd343 req-3dc4a7af-83ff-4a45-b970-c677a4c09f68 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Updated VIF entry in instance network info cache for port 428c8372-75c3-4d2d-a626-41a1bc868f2f. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG nova.network.neutron [req-3b877cf3-ebf0-41a2-9433-424daaafd343 req-3dc4a7af-83ff-4a45-b970-c677a4c09f68 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Updating instance_info_cache with network_info: [{"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3b877cf3-ebf0-41a2-9433-424daaafd343 req-3dc4a7af-83ff-4a45-b970-c677a4c09f68 service nova] Releasing lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:38:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d1c8662-36fa-48e1-a6e9-f276eaddb9e4 req-0bc21a08-1e8c-43e8-9326-19464f04c909 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received event network-vif-plugged-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d1c8662-36fa-48e1-a6e9-f276eaddb9e4 req-0bc21a08-1e8c-43e8-9326-19464f04c909 service nova] Acquiring lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d1c8662-36fa-48e1-a6e9-f276eaddb9e4 req-0bc21a08-1e8c-43e8-9326-19464f04c909 service nova] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d1c8662-36fa-48e1-a6e9-f276eaddb9e4 req-0bc21a08-1e8c-43e8-9326-19464f04c909 service nova] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d1c8662-36fa-48e1-a6e9-f276eaddb9e4 req-0bc21a08-1e8c-43e8-9326-19464f04c909 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] No waiting events found dispatching network-vif-plugged-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:36 user nova-compute[73067]: WARNING nova.compute.manager [req-8d1c8662-36fa-48e1-a6e9-f276eaddb9e4 req-0bc21a08-1e8c-43e8-9326-19464f04c909 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received unexpected event network-vif-plugged-428c8372-75c3-4d2d-a626-41a1bc868f2f for instance with vm_state building and task_state spawning.
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:38:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-b207b784-2af7-463b-916c-e081a4d43f80 req-7acb64c6-6401-4dfc-a2a4-ca74f994a328 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received event network-vif-plugged-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b207b784-2af7-463b-916c-e081a4d43f80 req-7acb64c6-6401-4dfc-a2a4-ca74f994a328 service nova] Acquiring lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b207b784-2af7-463b-916c-e081a4d43f80 req-7acb64c6-6401-4dfc-a2a4-ca74f994a328 service nova] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b207b784-2af7-463b-916c-e081a4d43f80 req-7acb64c6-6401-4dfc-a2a4-ca74f994a328 service nova] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-b207b784-2af7-463b-916c-e081a4d43f80 req-7acb64c6-6401-4dfc-a2a4-ca74f994a328 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] No waiting events found dispatching network-vif-plugged-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:38 user nova-compute[73067]: WARNING nova.compute.manager [req-b207b784-2af7-463b-916c-e081a4d43f80 req-7acb64c6-6401-4dfc-a2a4-ca74f994a328 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received unexpected event network-vif-plugged-428c8372-75c3-4d2d-a626-41a1bc868f2f for instance with vm_state building and task_state spawning.
Aug 16 10:38:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182318.4832482, 7f99c350-1c4e-47e8-884a-e821b6dd83bc => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:39 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] VM Resumed (Lifecycle Event)
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:38:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7319MB free_disk=25.265453338623047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Instance spawned successfully.
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:38:39 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182318.4845421, 7f99c350-1c4e-47e8-884a-e821b6dd83bc => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:39 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] VM Started (Lifecycle Event)
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:38:39 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:38:39 user nova-compute[73067]: INFO nova.compute.manager [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Took 10.85 seconds to spawn the instance on the hypervisor.
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance b51879a0-d5a1-4f96-b0c1-0672d31e80db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ffe1f07d-0a48-431d-be98-7e78018faa10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fcb6379a-4c57-462b-a4ea-9680340a5137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0f85b78e-78c3-4e5a-a33d-ace04474a737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance bc035e99-1a53-43df-8946-9c86ce2ecb0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 74a885f5-8405-444e-a620-ddd0ef0d1641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 7f99c350-1c4e-47e8-884a-e821b6dd83bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:38:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:38:39 user nova-compute[73067]: INFO nova.compute.manager [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Took 11.90 seconds to build instance.
Aug 16 10:38:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-32bd2d4e-bce3-4863-b6c6-37a5b95f6519 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.061s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:40 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:38:40 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:38:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:38:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.975s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:38:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:38:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:38:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:38:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:38:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:43 user nova-compute[73067]: INFO nova.compute.manager [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Terminating instance
Aug 16 10:38:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:38:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-96918133-cecd-4d33-8b07-2958cdadf41e req-9eb125ff-1d60-4778-b866-bd3057cd362c service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Received event network-vif-unplugged-e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-96918133-cecd-4d33-8b07-2958cdadf41e req-9eb125ff-1d60-4778-b866-bd3057cd362c service nova] Acquiring lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-96918133-cecd-4d33-8b07-2958cdadf41e req-9eb125ff-1d60-4778-b866-bd3057cd362c service nova] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-96918133-cecd-4d33-8b07-2958cdadf41e req-9eb125ff-1d60-4778-b866-bd3057cd362c service nova] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-96918133-cecd-4d33-8b07-2958cdadf41e req-9eb125ff-1d60-4778-b866-bd3057cd362c service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] No waiting events found dispatching network-vif-unplugged-e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-96918133-cecd-4d33-8b07-2958cdadf41e req-9eb125ff-1d60-4778-b866-bd3057cd362c service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Received event network-vif-unplugged-e67ff481-da2d-4922-9c80-dd085c42cc05 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Instance destroyed successfully.
Aug 16 10:38:44 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lazy-loading 'resources' on Instance uuid b51879a0-d5a1-4f96-b0c1-0672d31e80db {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1979248196',display_name='tempest-ServersNegativeTestJSON-server-1979248196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1979248196',id=2,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c56c1ffc9f4b4b63a31c6020cdc12f96',ramdisk_id='',reservation_id='r-0gj05vdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-29460834',owner_user_name='tempest-ServersNegativeTestJSON-29460834-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:29:54Z,user_data=None,user_id='7c965df8f8c240438581033b9004bea3',uuid=b51879a0-d5a1-4f96-b0c1-0672d31e80db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converting VIF {"id": "e67ff481-da2d-4922-9c80-dd085c42cc05", "address": "fa:16:3e:2a:47:ac", "network": {"id": "c665607f-03fd-42ed-9459-033c0450e090", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1098815196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c1ffc9f4b4b63a31c6020cdc12f96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape67ff481-da", "ovs_interfaceid": "e67ff481-da2d-4922-9c80-dd085c42cc05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:47:ac,bridge_name='br-int',has_traffic_filtering=True,id=e67ff481-da2d-4922-9c80-dd085c42cc05,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67ff481-da') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG os_vif [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:47:ac,bridge_name='br-int',has_traffic_filtering=True,id=e67ff481-da2d-4922-9c80-dd085c42cc05,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67ff481-da') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape67ff481-da, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:44 user nova-compute[73067]: INFO os_vif [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:47:ac,bridge_name='br-int',has_traffic_filtering=True,id=e67ff481-da2d-4922-9c80-dd085c42cc05,network=Network(c665607f-03fd-42ed-9459-033c0450e090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape67ff481-da')
Aug 16 10:38:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Deleting instance files /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db_del
Aug 16 10:38:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Deletion of /opt/stack/data/nova/instances/b51879a0-d5a1-4f96-b0c1-0672d31e80db_del complete
Aug 16 10:38:44 user nova-compute[73067]: INFO nova.compute.manager [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 16 10:38:44 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:38:44 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:38:45 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:45 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Took 0.96 seconds to deallocate network for instance.
Aug 16 10:38:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-9581975e-c581-47b8-9d82-7259db31cdd8 req-15c5c14f-2f12-46d3-a3bb-1359e7d362b9 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Received event network-vif-deleted-e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-a8dbc231-60fe-4a2f-b116-2395127d8d80 req-476bcf1a-15b5-4739-8c85-3908d98cf159 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Received event network-vif-plugged-e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a8dbc231-60fe-4a2f-b116-2395127d8d80 req-476bcf1a-15b5-4739-8c85-3908d98cf159 service nova] Acquiring lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a8dbc231-60fe-4a2f-b116-2395127d8d80 req-476bcf1a-15b5-4739-8c85-3908d98cf159 service nova] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a8dbc231-60fe-4a2f-b116-2395127d8d80 req-476bcf1a-15b5-4739-8c85-3908d98cf159 service nova] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-a8dbc231-60fe-4a2f-b116-2395127d8d80 req-476bcf1a-15b5-4739-8c85-3908d98cf159 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] No waiting events found dispatching network-vif-plugged-e67ff481-da2d-4922-9c80-dd085c42cc05 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:46 user nova-compute[73067]: WARNING nova.compute.manager [req-a8dbc231-60fe-4a2f-b116-2395127d8d80 req-476bcf1a-15b5-4739-8c85-3908d98cf159 service nova] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Received unexpected event network-vif-plugged-e67ff481-da2d-4922-9c80-dd085c42cc05 for instance with vm_state deleted and task_state None.
Aug 16 10:38:46 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:38:46 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:38:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:46 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Deleted allocations for instance b51879a0-d5a1-4f96-b0c1-0672d31e80db
Aug 16 10:38:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae3e1ce5-19a8-4539-87cb-99a8013acfa0 tempest-ServersNegativeTestJSON-29460834 tempest-ServersNegativeTestJSON-29460834-project-member] Lock "b51879a0-d5a1-4f96-b0c1-0672d31e80db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.876s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "80c5b266-d257-447f-9c43-49e9a5455aef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:38:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:38:49 user nova-compute[73067]: INFO nova.compute.claims [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Claim successful on node user
Aug 16 10:38:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:49 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:38:49 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:38:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:50 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:38:50 user nova-compute[73067]: INFO nova.compute.claims [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Claim successful on node user
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:38:50 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Creating image(s)
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.policy [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '735a6aba3e974eb29e45ec3a7aa8c5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687a889259b948fa985ce7c9b84b030a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.207s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk 1073741824" returned: 0 in 0.054s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:38:50 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.868s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Cannot resize image /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.objects.instance [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'migration_context' on Instance uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Ensure instance console log exists: /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:38:51 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.policy [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '735a6aba3e974eb29e45ec3a7aa8c5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687a889259b948fa985ce7c9b84b030a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-be10fdd2-5992-49b1-9983-74639ea1d896 req-dc996ec4-ffb4-4810-8358-3609c44883f8 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received event network-changed-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-be10fdd2-5992-49b1-9983-74639ea1d896 req-dc996ec4-ffb4-4810-8358-3609c44883f8 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Refreshing instance network info cache due to event network-changed-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-be10fdd2-5992-49b1-9983-74639ea1d896 req-dc996ec4-ffb4-4810-8358-3609c44883f8 service nova] Acquiring lock "refresh_cache-74a885f5-8405-444e-a620-ddd0ef0d1641" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-be10fdd2-5992-49b1-9983-74639ea1d896 req-dc996ec4-ffb4-4810-8358-3609c44883f8 service nova] Acquired lock "refresh_cache-74a885f5-8405-444e-a620-ddd0ef0d1641" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-be10fdd2-5992-49b1-9983-74639ea1d896 req-dc996ec4-ffb4-4810-8358-3609c44883f8 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Refreshing network info cache for port a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Successfully created port: cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:38:51 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Creating image(s)
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.208s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "74a885f5-8405-444e-a620-ddd0ef0d1641" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:51 user nova-compute[73067]: INFO nova.compute.manager [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Terminating instance
Aug 16 10:38:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.216s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk 1073741824" returned: 0 in 0.082s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.network.neutron [req-be10fdd2-5992-49b1-9983-74639ea1d896 req-dc996ec4-ffb4-4810-8358-3609c44883f8 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Updated VIF entry in instance network info cache for port a72becbf-c6c6-424f-ac4c-d114f5f7eb3c. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.network.neutron [req-be10fdd2-5992-49b1-9983-74639ea1d896 req-dc996ec4-ffb4-4810-8358-3609c44883f8 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Updating instance_info_cache with network_info: [{"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-be10fdd2-5992-49b1-9983-74639ea1d896 req-dc996ec4-ffb4-4810-8358-3609c44883f8 service nova] Releasing lock "refresh_cache-74a885f5-8405-444e-a620-ddd0ef0d1641" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-816ba353-9916-4fbd-9ad4-e0795691ae5f req-92449a72-e174-442f-9aaa-29e96e51add8 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received event network-vif-unplugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-816ba353-9916-4fbd-9ad4-e0795691ae5f req-92449a72-e174-442f-9aaa-29e96e51add8 service nova] Acquiring lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-816ba353-9916-4fbd-9ad4-e0795691ae5f req-92449a72-e174-442f-9aaa-29e96e51add8 service nova] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-816ba353-9916-4fbd-9ad4-e0795691ae5f req-92449a72-e174-442f-9aaa-29e96e51add8 service nova] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-816ba353-9916-4fbd-9ad4-e0795691ae5f req-92449a72-e174-442f-9aaa-29e96e51add8 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] No waiting events found dispatching network-vif-unplugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-816ba353-9916-4fbd-9ad4-e0795691ae5f req-92449a72-e174-442f-9aaa-29e96e51add8 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received event network-vif-unplugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Cannot resize image /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'migration_context' on Instance uuid f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Ensure instance console log exists: /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Successfully created port: b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:52 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Instance destroyed successfully.
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'resources' on Instance uuid 74a885f5-8405-444e-a620-ddd0ef0d1641 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-679794657',display_name='tempest-AttachVolumeNegativeTest-server-679794657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-679794657',id=23,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7IscvtNy8DrQENDGSMs0r5oP9QP+NVzt+jn2p/lPeYgMTkke3gGn6SMDgtaACkWeVFYE4Q5foswGo86PgT1zCB8sS6wJn7I1QyZZCqGCNjtDsBuWAuy3LgSLdTHgUm5g==',key_name='tempest-keypair-973130580',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-7trh0ig2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=74a885f5-8405-444e-a620-ddd0ef0d1641,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "address": "fa:16:3e:65:0f:55", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72becbf-c6", "ovs_interfaceid": "a72becbf-c6c6-424f-ac4c-d114f5f7eb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0f:55,bridge_name='br-int',has_traffic_filtering=True,id=a72becbf-c6c6-424f-ac4c-d114f5f7eb3c,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72becbf-c6') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG os_vif [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0f:55,bridge_name='br-int',has_traffic_filtering=True,id=a72becbf-c6c6-424f-ac4c-d114f5f7eb3c,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72becbf-c6') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa72becbf-c6, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:38:52 user nova-compute[73067]: INFO os_vif [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0f:55,bridge_name='br-int',has_traffic_filtering=True,id=a72becbf-c6c6-424f-ac4c-d114f5f7eb3c,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72becbf-c6')
Aug 16 10:38:52 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Deleting instance files /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641_del
Aug 16 10:38:52 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Deletion of /opt/stack/data/nova/instances/74a885f5-8405-444e-a620-ddd0ef0d1641_del complete
Aug 16 10:38:52 user nova-compute[73067]: INFO nova.compute.manager [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 10:38:52 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:38:52 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:38:53 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Successfully updated port: cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:38:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:38:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquired lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:38:53 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:38:53 user nova-compute[73067]: DEBUG nova.compute.manager [req-37cffd41-7f9c-4421-ac29-758951616196 req-dff35223-6a63-4eb3-8a0b-d1e1e145dfb7 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-changed-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:53 user nova-compute[73067]: DEBUG nova.compute.manager [req-37cffd41-7f9c-4421-ac29-758951616196 req-dff35223-6a63-4eb3-8a0b-d1e1e145dfb7 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Refreshing instance network info cache due to event network-changed-cd4abca0-e551-48f4-8d79-ce2ca1665dde. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:38:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-37cffd41-7f9c-4421-ac29-758951616196 req-dff35223-6a63-4eb3-8a0b-d1e1e145dfb7 service nova] Acquiring lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:38:53 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Successfully updated port: b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.network.neutron [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updating instance_info_cache with network_info: [{"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquired lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Releasing lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Instance network_info: |[{"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-37cffd41-7f9c-4421-ac29-758951616196 req-dff35223-6a63-4eb3-8a0b-d1e1e145dfb7 service nova] Acquired lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.network.neutron [req-37cffd41-7f9c-4421-ac29-758951616196 req-dff35223-6a63-4eb3-8a0b-d1e1e145dfb7 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Refreshing network info cache for port cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Start _get_guest_xml network_info=[{"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:38:54 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:54 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2105896710',display_name='tempest-ServerRescueNegativeTestJSON-server-2105896710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2105896710',id=27,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-enqd2hwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:38:50Z,user_data=None,user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=80c5b266-d257-447f-9c43-49e9a5455aef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b2:37,bridge_name='br-int',has_traffic_filtering=True,id=cd4abca0-e551-48f4-8d79-ce2ca1665dde,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4abca0-e5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.objects.instance [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'pci_devices' on Instance uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:38:54 user nova-compute[73067]:   <uuid>80c5b266-d257-447f-9c43-49e9a5455aef</uuid>
Aug 16 10:38:54 user nova-compute[73067]:   <name>instance-0000001b</name>
Aug 16 10:38:54 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:38:54 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:38:54 user nova-compute[73067]:   <metadata>
Aug 16 10:38:54 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:38:54 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:38:54 user nova-compute[73067]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2105896710</nova:name>
Aug 16 10:38:54 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:38:54</nova:creationTime>
Aug 16 10:38:54 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:38:54 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:38:54 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:38:54 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:38:54 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:38:54 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:38:54 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:38:54 user nova-compute[73067]:       <nova:owner>
Aug 16 10:38:54 user nova-compute[73067]:         <nova:user uuid="735a6aba3e974eb29e45ec3a7aa8c5cc">tempest-ServerRescueNegativeTestJSON-411494625-project-member</nova:user>
Aug 16 10:38:54 user nova-compute[73067]:         <nova:project uuid="687a889259b948fa985ce7c9b84b030a">tempest-ServerRescueNegativeTestJSON-411494625</nova:project>
Aug 16 10:38:54 user nova-compute[73067]:       </nova:owner>
Aug 16 10:38:54 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:38:54 user nova-compute[73067]:       <nova:ports>
Aug 16 10:38:54 user nova-compute[73067]:         <nova:port uuid="cd4abca0-e551-48f4-8d79-ce2ca1665dde">
Aug 16 10:38:54 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 10:38:54 user nova-compute[73067]:         </nova:port>
Aug 16 10:38:54 user nova-compute[73067]:       </nova:ports>
Aug 16 10:38:54 user nova-compute[73067]:     </nova:instance>
Aug 16 10:38:54 user nova-compute[73067]:   </metadata>
Aug 16 10:38:54 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:38:54 user nova-compute[73067]:     <system>
Aug 16 10:38:54 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:38:54 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:38:54 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:38:54 user nova-compute[73067]:       <entry name="serial">80c5b266-d257-447f-9c43-49e9a5455aef</entry>
Aug 16 10:38:54 user nova-compute[73067]:       <entry name="uuid">80c5b266-d257-447f-9c43-49e9a5455aef</entry>
Aug 16 10:38:54 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:38:54 user nova-compute[73067]:     </system>
Aug 16 10:38:54 user nova-compute[73067]:   </sysinfo>
Aug 16 10:38:54 user nova-compute[73067]:   <os>
Aug 16 10:38:54 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:38:54 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:38:54 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:38:54 user nova-compute[73067]:   </os>
Aug 16 10:38:54 user nova-compute[73067]:   <features>
Aug 16 10:38:54 user nova-compute[73067]:     <acpi/>
Aug 16 10:38:54 user nova-compute[73067]:     <apic/>
Aug 16 10:38:54 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:38:54 user nova-compute[73067]:   </features>
Aug 16 10:38:54 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:38:54 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:38:54 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:38:54 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:38:54 user nova-compute[73067]:   </clock>
Aug 16 10:38:54 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:38:54 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:38:54 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:38:54 user nova-compute[73067]:   </cpu>
Aug 16 10:38:54 user nova-compute[73067]:   <devices>
Aug 16 10:38:54 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:38:54 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:38:54 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk"/>
Aug 16 10:38:54 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:38:54 user nova-compute[73067]:     </disk>
Aug 16 10:38:54 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:38:54 user nova-compute[73067]:       <mac address="fa:16:3e:f7:b2:37"/>
Aug 16 10:38:54 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:38:54 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:38:54 user nova-compute[73067]:       <target dev="tapcd4abca0-e5"/>
Aug 16 10:38:54 user nova-compute[73067]:     </interface>
Aug 16 10:38:54 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:38:54 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/console.log" append="off"/>
Aug 16 10:38:54 user nova-compute[73067]:     </serial>
Aug 16 10:38:54 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:38:54 user nova-compute[73067]:     <video>
Aug 16 10:38:54 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:38:54 user nova-compute[73067]:     </video>
Aug 16 10:38:54 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:38:54 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:38:54 user nova-compute[73067]:     </rng>
Aug 16 10:38:54 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:38:54 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:38:54 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:38:54 user nova-compute[73067]:     </memballoon>
Aug 16 10:38:54 user nova-compute[73067]:   </devices>
Aug 16 10:38:54 user nova-compute[73067]: </domain>
Aug 16 10:38:54 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2105896710',display_name='tempest-ServerRescueNegativeTestJSON-server-2105896710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2105896710',id=27,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-enqd2hwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:38:50Z,user_data=None,user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=80c5b266-d257-447f-9c43-49e9a5455aef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b2:37,bridge_name='br-int',has_traffic_filtering=True,id=cd4abca0-e551-48f4-8d79-ce2ca1665dde,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4abca0-e5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG os_vif [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b2:37,bridge_name='br-int',has_traffic_filtering=True,id=cd4abca0-e551-48f4-8d79-ce2ca1665dde,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4abca0-e5') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd4abca0-e5, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd4abca0-e5, col_values=(('external_ids', {'iface-id': 'cd4abca0-e551-48f4-8d79-ce2ca1665dde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:b2:37', 'vm-uuid': '80c5b266-d257-447f-9c43-49e9a5455aef'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:38:54 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Took 1.56 seconds to deallocate network for instance.
Aug 16 10:38:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:54 user nova-compute[73067]: INFO os_vif [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b2:37,bridge_name='br-int',has_traffic_filtering=True,id=cd4abca0-e551-48f4-8d79-ce2ca1665dde,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4abca0-e5')
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.compute.manager [req-f6effb75-06cd-44db-a586-bd17f3c9acfc req-148d7856-8917-4a01-bc89-d4cf3bc4cf83 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received event network-vif-plugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f6effb75-06cd-44db-a586-bd17f3c9acfc req-148d7856-8917-4a01-bc89-d4cf3bc4cf83 service nova] Acquiring lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f6effb75-06cd-44db-a586-bd17f3c9acfc req-148d7856-8917-4a01-bc89-d4cf3bc4cf83 service nova] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f6effb75-06cd-44db-a586-bd17f3c9acfc req-148d7856-8917-4a01-bc89-d4cf3bc4cf83 service nova] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.compute.manager [req-f6effb75-06cd-44db-a586-bd17f3c9acfc req-148d7856-8917-4a01-bc89-d4cf3bc4cf83 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] No waiting events found dispatching network-vif-plugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:54 user nova-compute[73067]: WARNING nova.compute.manager [req-f6effb75-06cd-44db-a586-bd17f3c9acfc req-148d7856-8917-4a01-bc89-d4cf3bc4cf83 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received unexpected event network-vif-plugged-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c for instance with vm_state active and task_state deleting.
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.compute.manager [req-f6effb75-06cd-44db-a586-bd17f3c9acfc req-148d7856-8917-4a01-bc89-d4cf3bc4cf83 service nova] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Received event network-vif-deleted-a72becbf-c6c6-424f-ac4c-d114f5f7eb3c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No VIF found with MAC fa:16:3e:f7:b2:37, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:54 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Deleted allocations for instance 74a885f5-8405-444e-a620-ddd0ef0d1641
Aug 16 10:38:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9040a7b5-5043-4b0d-a945-e17f173df8c0 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "74a885f5-8405-444e-a620-ddd0ef0d1641" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.050s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Updating instance_info_cache with network_info: [{"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Releasing lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Instance network_info: |[{"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Start _get_guest_xml network_info=[{"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:38:55 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:55 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1969020103',display_name='tempest-ServerRescueNegativeTestJSON-server-1969020103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1969020103',id=28,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-4faijbkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:38:51Z,user_data=None,user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=b466c179-fedb-44c5-84db-52a28279e32c,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb466c179-fe') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'pci_devices' on Instance uuid f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:38:55 user nova-compute[73067]:   <uuid>f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7</uuid>
Aug 16 10:38:55 user nova-compute[73067]:   <name>instance-0000001c</name>
Aug 16 10:38:55 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:38:55 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:38:55 user nova-compute[73067]:   <metadata>
Aug 16 10:38:55 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:38:55 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:38:55 user nova-compute[73067]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1969020103</nova:name>
Aug 16 10:38:55 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:38:55</nova:creationTime>
Aug 16 10:38:55 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:38:55 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:38:55 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:38:55 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:38:55 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:38:55 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:38:55 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:38:55 user nova-compute[73067]:       <nova:owner>
Aug 16 10:38:55 user nova-compute[73067]:         <nova:user uuid="735a6aba3e974eb29e45ec3a7aa8c5cc">tempest-ServerRescueNegativeTestJSON-411494625-project-member</nova:user>
Aug 16 10:38:55 user nova-compute[73067]:         <nova:project uuid="687a889259b948fa985ce7c9b84b030a">tempest-ServerRescueNegativeTestJSON-411494625</nova:project>
Aug 16 10:38:55 user nova-compute[73067]:       </nova:owner>
Aug 16 10:38:55 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:38:55 user nova-compute[73067]:       <nova:ports>
Aug 16 10:38:55 user nova-compute[73067]:         <nova:port uuid="b466c179-fedb-44c5-84db-52a28279e32c">
Aug 16 10:38:55 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 10:38:55 user nova-compute[73067]:         </nova:port>
Aug 16 10:38:55 user nova-compute[73067]:       </nova:ports>
Aug 16 10:38:55 user nova-compute[73067]:     </nova:instance>
Aug 16 10:38:55 user nova-compute[73067]:   </metadata>
Aug 16 10:38:55 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:38:55 user nova-compute[73067]:     <system>
Aug 16 10:38:55 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:38:55 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:38:55 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:38:55 user nova-compute[73067]:       <entry name="serial">f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7</entry>
Aug 16 10:38:55 user nova-compute[73067]:       <entry name="uuid">f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7</entry>
Aug 16 10:38:55 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:38:55 user nova-compute[73067]:     </system>
Aug 16 10:38:55 user nova-compute[73067]:   </sysinfo>
Aug 16 10:38:55 user nova-compute[73067]:   <os>
Aug 16 10:38:55 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:38:55 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:38:55 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:38:55 user nova-compute[73067]:   </os>
Aug 16 10:38:55 user nova-compute[73067]:   <features>
Aug 16 10:38:55 user nova-compute[73067]:     <acpi/>
Aug 16 10:38:55 user nova-compute[73067]:     <apic/>
Aug 16 10:38:55 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:38:55 user nova-compute[73067]:   </features>
Aug 16 10:38:55 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:38:55 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:38:55 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:38:55 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:38:55 user nova-compute[73067]:   </clock>
Aug 16 10:38:55 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:38:55 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:38:55 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:38:55 user nova-compute[73067]:   </cpu>
Aug 16 10:38:55 user nova-compute[73067]:   <devices>
Aug 16 10:38:55 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:38:55 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:38:55 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk"/>
Aug 16 10:38:55 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:38:55 user nova-compute[73067]:     </disk>
Aug 16 10:38:55 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:38:55 user nova-compute[73067]:       <mac address="fa:16:3e:91:ac:12"/>
Aug 16 10:38:55 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:38:55 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:38:55 user nova-compute[73067]:       <target dev="tapb466c179-fe"/>
Aug 16 10:38:55 user nova-compute[73067]:     </interface>
Aug 16 10:38:55 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:38:55 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/console.log" append="off"/>
Aug 16 10:38:55 user nova-compute[73067]:     </serial>
Aug 16 10:38:55 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:38:55 user nova-compute[73067]:     <video>
Aug 16 10:38:55 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:38:55 user nova-compute[73067]:     </video>
Aug 16 10:38:55 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:38:55 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:38:55 user nova-compute[73067]:     </rng>
Aug 16 10:38:55 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:38:55 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:38:55 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:38:55 user nova-compute[73067]:     </memballoon>
Aug 16 10:38:55 user nova-compute[73067]:   </devices>
Aug 16 10:38:55 user nova-compute[73067]: </domain>
Aug 16 10:38:55 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1969020103',display_name='tempest-ServerRescueNegativeTestJSON-server-1969020103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1969020103',id=28,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-4faijbkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:38:51Z,user_data=None,user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=b466c179-fedb-44c5-84db-52a28279e32c,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb466c179-fe') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG os_vif [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=b466c179-fedb-44c5-84db-52a28279e32c,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb466c179-fe') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb466c179-fe, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb466c179-fe, col_values=(('external_ids', {'iface-id': 'b466c179-fedb-44c5-84db-52a28279e32c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:ac:12', 'vm-uuid': 'f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:55 user nova-compute[73067]: INFO os_vif [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=b466c179-fedb-44c5-84db-52a28279e32c,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb466c179-fe')
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No VIF found with MAC fa:16:3e:91:ac:12, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.network.neutron [req-37cffd41-7f9c-4421-ac29-758951616196 req-dff35223-6a63-4eb3-8a0b-d1e1e145dfb7 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updated VIF entry in instance network info cache for port cd4abca0-e551-48f4-8d79-ce2ca1665dde. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.network.neutron [req-37cffd41-7f9c-4421-ac29-758951616196 req-dff35223-6a63-4eb3-8a0b-d1e1e145dfb7 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updating instance_info_cache with network_info: [{"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-37cffd41-7f9c-4421-ac29-758951616196 req-dff35223-6a63-4eb3-8a0b-d1e1e145dfb7 service nova] Releasing lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-8b0700c5-2528-4224-8704-e1be3e7e623e req-a3a6e5c9-c9fe-4461-800b-bb71fce52913 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-changed-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-8b0700c5-2528-4224-8704-e1be3e7e623e req-a3a6e5c9-c9fe-4461-800b-bb71fce52913 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Refreshing instance network info cache due to event network-changed-b466c179-fedb-44c5-84db-52a28279e32c. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8b0700c5-2528-4224-8704-e1be3e7e623e req-a3a6e5c9-c9fe-4461-800b-bb71fce52913 service nova] Acquiring lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8b0700c5-2528-4224-8704-e1be3e7e623e req-a3a6e5c9-c9fe-4461-800b-bb71fce52913 service nova] Acquired lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.network.neutron [req-8b0700c5-2528-4224-8704-e1be3e7e623e req-a3a6e5c9-c9fe-4461-800b-bb71fce52913 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Refreshing network info cache for port b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c2fa2d5-907a-422b-b865-0e57815de7ab req-404a2ccf-d9fd-4c2f-bda6-1ffbca1e6002 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c2fa2d5-907a-422b-b865-0e57815de7ab req-404a2ccf-d9fd-4c2f-bda6-1ffbca1e6002 service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c2fa2d5-907a-422b-b865-0e57815de7ab req-404a2ccf-d9fd-4c2f-bda6-1ffbca1e6002 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8c2fa2d5-907a-422b-b865-0e57815de7ab req-404a2ccf-d9fd-4c2f-bda6-1ffbca1e6002 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-8c2fa2d5-907a-422b-b865-0e57815de7ab req-404a2ccf-d9fd-4c2f-bda6-1ffbca1e6002 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:55 user nova-compute[73067]: WARNING nova.compute.manager [req-8c2fa2d5-907a-422b-b865-0e57815de7ab req-404a2ccf-d9fd-4c2f-bda6-1ffbca1e6002 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state building and task_state spawning.
Aug 16 10:38:56 user nova-compute[73067]: DEBUG nova.network.neutron [req-8b0700c5-2528-4224-8704-e1be3e7e623e req-a3a6e5c9-c9fe-4461-800b-bb71fce52913 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Updated VIF entry in instance network info cache for port b466c179-fedb-44c5-84db-52a28279e32c. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:38:56 user nova-compute[73067]: DEBUG nova.network.neutron [req-8b0700c5-2528-4224-8704-e1be3e7e623e req-a3a6e5c9-c9fe-4461-800b-bb71fce52913 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Updating instance_info_cache with network_info: [{"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:38:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8b0700c5-2528-4224-8704-e1be3e7e623e req-a3a6e5c9-c9fe-4461-800b-bb71fce52913 service nova] Releasing lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:38:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-f0025919-b2d0-4fd5-8ddd-aa8ae3e900e8 req-caeb3e0d-140c-4677-b8ac-fa539c065ee8 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f0025919-b2d0-4fd5-8ddd-aa8ae3e900e8 req-caeb3e0d-140c-4677-b8ac-fa539c065ee8 service nova] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f0025919-b2d0-4fd5-8ddd-aa8ae3e900e8 req-caeb3e0d-140c-4677-b8ac-fa539c065ee8 service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f0025919-b2d0-4fd5-8ddd-aa8ae3e900e8 req-caeb3e0d-140c-4677-b8ac-fa539c065ee8 service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-f0025919-b2d0-4fd5-8ddd-aa8ae3e900e8 req-caeb3e0d-140c-4677-b8ac-fa539c065ee8 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] No waiting events found dispatching network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:57 user nova-compute[73067]: WARNING nova.compute.manager [req-f0025919-b2d0-4fd5-8ddd-aa8ae3e900e8 req-caeb3e0d-140c-4677-b8ac-fa539c065ee8 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received unexpected event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c for instance with vm_state building and task_state spawning.
Aug 16 10:38:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-7b1242c6-6712-4276-b173-987071efd4bd req-fec8fa02-3795-4739-ae7c-533975610259 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7b1242c6-6712-4276-b173-987071efd4bd req-fec8fa02-3795-4739-ae7c-533975610259 service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7b1242c6-6712-4276-b173-987071efd4bd req-fec8fa02-3795-4739-ae7c-533975610259 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7b1242c6-6712-4276-b173-987071efd4bd req-fec8fa02-3795-4739-ae7c-533975610259 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-7b1242c6-6712-4276-b173-987071efd4bd req-fec8fa02-3795-4739-ae7c-533975610259 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:57 user nova-compute[73067]: WARNING nova.compute.manager [req-7b1242c6-6712-4276-b173-987071efd4bd req-fec8fa02-3795-4739-ae7c-533975610259 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state building and task_state spawning.
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182338.9148152, 80c5b266-d257-447f-9c43-49e9a5455aef => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] VM Resumed (Lifecycle Event)
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:38:58 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Instance spawned successfully.
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182338.9177277, 80c5b266-d257-447f-9c43-49e9a5455aef => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:58 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] VM Started (Lifecycle Event)
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.compute.manager [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Took 8.84 seconds to spawn the instance on the hypervisor.
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.compute.manager [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Took 9.86 seconds to build instance.
Aug 16 10:38:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6664fef5-32e1-4117-a537-75bba2967e75 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "80c5b266-d257-447f-9c43-49e9a5455aef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.959s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182339.3119142, f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] VM Resumed (Lifecycle Event)
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Instance spawned successfully.
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.compute.manager [req-b68f18a8-b60e-4df3-a7f1-100be04dc23d req-083cdf37-a305-4ded-8209-34a6108730da service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b68f18a8-b60e-4df3-a7f1-100be04dc23d req-083cdf37-a305-4ded-8209-34a6108730da service nova] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b68f18a8-b60e-4df3-a7f1-100be04dc23d req-083cdf37-a305-4ded-8209-34a6108730da service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b68f18a8-b60e-4df3-a7f1-100be04dc23d req-083cdf37-a305-4ded-8209-34a6108730da service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.compute.manager [req-b68f18a8-b60e-4df3-a7f1-100be04dc23d req-083cdf37-a305-4ded-8209-34a6108730da service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] No waiting events found dispatching network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:38:59 user nova-compute[73067]: WARNING nova.compute.manager [req-b68f18a8-b60e-4df3-a7f1-100be04dc23d req-083cdf37-a305-4ded-8209-34a6108730da service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received unexpected event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c for instance with vm_state building and task_state spawning.
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182339.313309, f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] VM Started (Lifecycle Event)
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.compute.manager [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Took 8.16 seconds to spawn the instance on the hypervisor.
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182324.5644972, b51879a0-d5a1-4f96-b0c1-0672d31e80db => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] VM Stopped (Lifecycle Event)
Aug 16 10:38:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f3f05f86-bc75-44ce-92cf-ca6e7c03aa58 None None] [instance: b51879a0-d5a1-4f96-b0c1-0672d31e80db] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:38:59 user nova-compute[73067]: INFO nova.compute.manager [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Took 9.45 seconds to build instance.
Aug 16 10:38:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e8480b70-0fe0-434d-8f18-555b221e85bb tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.547s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:07 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182332.516763, 74a885f5-8405-444e-a620-ddd0ef0d1641 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:39:07 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] VM Stopped (Lifecycle Event)
Aug 16 10:39:07 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d43dea96-a424-41a8-ab4f-f0ade5492add None None] [instance: 74a885f5-8405-444e-a620-ddd0ef0d1641] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:39:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:08 user nova-compute[73067]: INFO nova.compute.manager [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Detaching volume f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d
Aug 16 10:39:08 user nova-compute[73067]: INFO nova.virt.block_device [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Attempting to driver detach volume f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d from mountpoint /dev/vdb
Aug 16 10:39:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Attempting to detach device vdb from instance bc035e99-1a53-43df-8946-9c86ce2ecb0b from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:39:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:39:08 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:39:08 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:39:08 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:39:08 user nova-compute[73067]:   <serial>f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d</serial>
Aug 16 10:39:08 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:39:08 user nova-compute[73067]: </disk>
Aug 16 10:39:08 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:39:08 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Successfully detached device vdb from instance bc035e99-1a53-43df-8946-9c86ce2ecb0b from the persistent domain config.
Aug 16 10:39:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc035e99-1a53-43df-8946-9c86ce2ecb0b from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:39:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:39:08 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:39:08 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:39:08 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:39:08 user nova-compute[73067]:   <serial>f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d</serial>
Aug 16 10:39:08 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:39:08 user nova-compute[73067]: </disk>
Aug 16 10:39:08 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:39:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182349.2524326, bc035e99-1a53-43df-8946-9c86ce2ecb0b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc035e99-1a53-43df-8946-9c86ce2ecb0b {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:39:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Successfully detached device vdb from instance bc035e99-1a53-43df-8946-9c86ce2ecb0b from the live domain config.
Aug 16 10:39:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEbfFKZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:39:09 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aca70d8-5f34-440a-ad1f-44d4167ecf1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[46def685-95b6-48f4-9e40-852fe18ce2ee]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:39:09 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:39:09 user nova-compute[73067]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)
Aug 16 10:39:09 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:39:09 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:39:09 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:39:09 user nova-compute[73067]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d (non-flash)
Aug 16 10:39:09 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:39:09 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3564118e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6fdafa-1457-4854-bf3f-102cb194813f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4078a772-9c09-42a5-a790-c031c345a216]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7178bd2e-a432-4fe4-96a5-8e6dbcd8eb20]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6064379e-d578-49d8-a022-1088fe5d2164]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f163e000-2b27-4302-8870-b66cbe4cf448]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[338b96cd-d000-4ce9-9609-f30f852cd324]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d, portal: 172.16.0.220,3260]
Aug 16 10:39:09 user nova-compute[73067]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d, portal: 172.16.0.220,3260] successful.
Aug 16 10:39:09 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2614e6a5-c63f-4c6f-85fb-fc696a7cbdcb]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] <== disconnect_volume: return (285ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:39:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG nova.objects.instance [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'flavor' on Instance uuid bc035e99-1a53-43df-8946-9c86ce2ecb0b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-55d42d8b-933a-4ce5-bd90-1b4c07ea0269 tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.715s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.591s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:10 user nova-compute[73067]: INFO nova.compute.manager [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Terminating instance
Aug 16 10:39:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-01ec1bb5-5ff7-4de8-aaa7-4d63e3af5986 req-b1e27e93-6095-4a2d-85cb-732c90690845 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received event network-vif-unplugged-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-01ec1bb5-5ff7-4de8-aaa7-4d63e3af5986 req-b1e27e93-6095-4a2d-85cb-732c90690845 service nova] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-01ec1bb5-5ff7-4de8-aaa7-4d63e3af5986 req-b1e27e93-6095-4a2d-85cb-732c90690845 service nova] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-01ec1bb5-5ff7-4de8-aaa7-4d63e3af5986 req-b1e27e93-6095-4a2d-85cb-732c90690845 service nova] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-01ec1bb5-5ff7-4de8-aaa7-4d63e3af5986 req-b1e27e93-6095-4a2d-85cb-732c90690845 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] No waiting events found dispatching network-vif-unplugged-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:39:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-01ec1bb5-5ff7-4de8-aaa7-4d63e3af5986 req-b1e27e93-6095-4a2d-85cb-732c90690845 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received event network-vif-unplugged-0e377513-686a-458a-b39d-95cd3b041864 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:39:11 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Instance destroyed successfully.
Aug 16 10:39:11 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lazy-loading 'resources' on Instance uuid bc035e99-1a53-43df-8946-9c86ce2ecb0b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-334963053',display_name='tempest-VolumesSnapshotTestJSON-instance-334963053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-334963053',id=22,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/CVWEpckZf/90salQQ6NE4POH/vzQPeoLKmvErfbzvmunuVVuekYoHfIIk23XWCMp0NtheoLz/IvmZXkgCEgPobwZf7TDWN28xapH959GCzYLilR/D84nlvBhJDqawCA==',key_name='tempest-keypair-357664148',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:35:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1171c517852847f5a1de1e6236fa753e',ramdisk_id='',reservation_id='r-55l2j93r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-78639816',owner_user_name='tempest-VolumesSnapshotTestJSON-78639816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcce750fe55c44809a3c42265e64f54c',uuid=bc035e99-1a53-43df-8946-9c86ce2ecb0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converting VIF {"id": "0e377513-686a-458a-b39d-95cd3b041864", "address": "fa:16:3e:b7:ad:bb", "network": {"id": "a77b9149-d6ce-4310-94cc-1b20adf16ec4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-503864028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1171c517852847f5a1de1e6236fa753e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e377513-68", "ovs_interfaceid": "0e377513-686a-458a-b39d-95cd3b041864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:ad:bb,bridge_name='br-int',has_traffic_filtering=True,id=0e377513-686a-458a-b39d-95cd3b041864,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e377513-68') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_vif [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:ad:bb,bridge_name='br-int',has_traffic_filtering=True,id=0e377513-686a-458a-b39d-95cd3b041864,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e377513-68') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e377513-68, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:39:11 user nova-compute[73067]: INFO os_vif [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:ad:bb,bridge_name='br-int',has_traffic_filtering=True,id=0e377513-686a-458a-b39d-95cd3b041864,network=Network(a77b9149-d6ce-4310-94cc-1b20adf16ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e377513-68')
Aug 16 10:39:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEbfFKZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:39:11 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f04f0fc6-8ec8-4d23-b37e-a97e1cba8b4d', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fa4475-be09-449e-bc60-c64e29ef7220]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9178e00b-e893-4757-b59c-ac5c63d7cf86]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:39:11 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:39:11 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:39:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:39:11 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:39:11 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:39:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642db0a0>, {}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Disconnecting from: [] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] <== disconnect_volume: return (48ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:39:11 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Deleting instance files /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b_del
Aug 16 10:39:11 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Deletion of /opt/stack/data/nova/instances/bc035e99-1a53-43df-8946-9c86ce2ecb0b_del complete
Aug 16 10:39:11 user nova-compute[73067]: INFO nova.compute.manager [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 10:39:11 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:39:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:12 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:39:12 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Took 0.98 seconds to deallocate network for instance.
Aug 16 10:39:12 user nova-compute[73067]: WARNING nova.volume.cinder [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Attachment 8710cfe3-ca16-4db9-b023-443cec6161ff does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8710cfe3-ca16-4db9-b023-443cec6161ff. (HTTP 404) (Request-ID: req-e3741bc9-a1ca-4d77-852a-4665e2dd2781)
Aug 16 10:39:12 user nova-compute[73067]: INFO nova.compute.manager [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Took 0.03 seconds to detach 1 volumes for instance.
Aug 16 10:39:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-01c782cb-3fd3-433f-b602-ee4ba6c56c0b req-d388bd67-8319-4c76-a7e3-9a8f5d430bd8 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received event network-vif-plugged-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:39:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-01c782cb-3fd3-433f-b602-ee4ba6c56c0b req-d388bd67-8319-4c76-a7e3-9a8f5d430bd8 service nova] Acquiring lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-01c782cb-3fd3-433f-b602-ee4ba6c56c0b req-d388bd67-8319-4c76-a7e3-9a8f5d430bd8 service nova] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-01c782cb-3fd3-433f-b602-ee4ba6c56c0b req-d388bd67-8319-4c76-a7e3-9a8f5d430bd8 service nova] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-01c782cb-3fd3-433f-b602-ee4ba6c56c0b req-d388bd67-8319-4c76-a7e3-9a8f5d430bd8 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] No waiting events found dispatching network-vif-plugged-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:39:13 user nova-compute[73067]: WARNING nova.compute.manager [req-01c782cb-3fd3-433f-b602-ee4ba6c56c0b req-d388bd67-8319-4c76-a7e3-9a8f5d430bd8 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received unexpected event network-vif-plugged-0e377513-686a-458a-b39d-95cd3b041864 for instance with vm_state deleted and task_state None.
Aug 16 10:39:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-01c782cb-3fd3-433f-b602-ee4ba6c56c0b req-d388bd67-8319-4c76-a7e3-9a8f5d430bd8 service nova] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Received event network-vif-deleted-0e377513-686a-458a-b39d-95cd3b041864 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:39:13 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:39:13 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:39:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.044s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:13 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Deleted allocations for instance bc035e99-1a53-43df-8946-9c86ce2ecb0b
Aug 16 10:39:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cd12c1f3-89ca-4321-adad-fe0cc576100a tempest-VolumesSnapshotTestJSON-78639816 tempest-VolumesSnapshotTestJSON-78639816-project-member] Lock "bc035e99-1a53-43df-8946-9c86ce2ecb0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.311s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:21 user nova-compute[73067]: INFO nova.compute.manager [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Terminating instance
Aug 16 10:39:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-1657e9d6-65f9-410b-a20e-4e4b88470ee3 req-4e3600c9-04d8-48bc-8921-0c5e5ff17feb service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-vif-unplugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1657e9d6-65f9-410b-a20e-4e4b88470ee3 req-4e3600c9-04d8-48bc-8921-0c5e5ff17feb service nova] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1657e9d6-65f9-410b-a20e-4e4b88470ee3 req-4e3600c9-04d8-48bc-8921-0c5e5ff17feb service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1657e9d6-65f9-410b-a20e-4e4b88470ee3 req-4e3600c9-04d8-48bc-8921-0c5e5ff17feb service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-1657e9d6-65f9-410b-a20e-4e4b88470ee3 req-4e3600c9-04d8-48bc-8921-0c5e5ff17feb service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] No waiting events found dispatching network-vif-unplugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-1657e9d6-65f9-410b-a20e-4e4b88470ee3 req-4e3600c9-04d8-48bc-8921-0c5e5ff17feb service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-vif-unplugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Instance destroyed successfully.
Aug 16 10:39:22 user nova-compute[73067]: DEBUG nova.objects.instance [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'resources' on Instance uuid ffe1f07d-0a48-431d-be98-7e78018faa10 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-474030065',display_name='tempest-ServerActionsTestOtherA-server-900219677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-474030065',id=16,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSwseBSIzKQEmuDvq8Hdi2xgXNDpzTwGm6gMW/fO7+s7B2Iv2Dv1yoN6p8FMkcmuvxctndByirO8QFQRXIfhiELJwq44/dD13T3UEuod/ThSU86msaJkBUM3PERa3slQQ==',key_name='tempest-keypair-433429582',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-4xf1pl3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=ffe1f07d-0a48-431d-be98-7e78018faa10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "address": "fa:16:3e:58:69:43", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4af474f-c8", "ovs_interfaceid": "f4af474f-c83b-403b-abed-abaf9c0e71f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG os_vif [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4af474f-c8, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:39:22 user nova-compute[73067]: INFO os_vif [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:69:43,bridge_name='br-int',has_traffic_filtering=True,id=f4af474f-c83b-403b-abed-abaf9c0e71f8,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4af474f-c8')
Aug 16 10:39:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Deleting instance files /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10_del
Aug 16 10:39:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Deletion of /opt/stack/data/nova/instances/ffe1f07d-0a48-431d-be98-7e78018faa10_del complete
Aug 16 10:39:22 user nova-compute[73067]: INFO nova.compute.manager [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 16 10:39:22 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:39:22 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:39:23 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:39:23 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Took 0.92 seconds to deallocate network for instance.
Aug 16 10:39:23 user nova-compute[73067]: DEBUG nova.compute.manager [req-21b8a280-3b34-44b9-a0c2-f0b4b5554e87 req-92c0b994-25aa-493b-8261-9c1fbf18ccd7 service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-vif-deleted-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:39:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:24 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:39:24 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:39:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:24 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Deleted allocations for instance ffe1f07d-0a48-431d-be98-7e78018faa10
Aug 16 10:39:24 user nova-compute[73067]: DEBUG nova.compute.manager [req-5ee8622b-4d35-40ca-a025-f1e43a7a869b req-8fa2410c-bb17-4e96-bb17-56d1a4f0936e service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:39:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5ee8622b-4d35-40ca-a025-f1e43a7a869b req-8fa2410c-bb17-4e96-bb17-56d1a4f0936e service nova] Acquiring lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5ee8622b-4d35-40ca-a025-f1e43a7a869b req-8fa2410c-bb17-4e96-bb17-56d1a4f0936e service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5ee8622b-4d35-40ca-a025-f1e43a7a869b req-8fa2410c-bb17-4e96-bb17-56d1a4f0936e service nova] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:24 user nova-compute[73067]: DEBUG nova.compute.manager [req-5ee8622b-4d35-40ca-a025-f1e43a7a869b req-8fa2410c-bb17-4e96-bb17-56d1a4f0936e service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] No waiting events found dispatching network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:39:24 user nova-compute[73067]: WARNING nova.compute.manager [req-5ee8622b-4d35-40ca-a025-f1e43a7a869b req-8fa2410c-bb17-4e96-bb17-56d1a4f0936e service nova] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Received unexpected event network-vif-plugged-f4af474f-c83b-403b-abed-abaf9c0e71f8 for instance with vm_state deleted and task_state None.
Aug 16 10:39:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-230d35ae-8543-4a56-9bd4-3cc91147c487 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "ffe1f07d-0a48-431d-be98-7e78018faa10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.398s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:26 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182351.1874301, bc035e99-1a53-43df-8946-9c86ce2ecb0b => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:39:26 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] VM Stopped (Lifecycle Event)
Aug 16 10:39:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a10a5ee6-38df-49e0-a346-1c44adbc36f0 None None] [instance: bc035e99-1a53-43df-8946-9c86ce2ecb0b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:39:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:39:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:39:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Updating instance_info_cache with network_info: [{"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-2448aa3f-a0a6-43c6-8844-dbfb8145d779" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:39:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.396s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182362.8926427, ffe1f07d-0a48-431d-be98-7e78018faa10 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:39:38 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] VM Stopped (Lifecycle Event)
Aug 16 10:39:38 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:39:38 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7305MB free_disk=25.277748107910156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c608c2ce-f18f-4d52-b22c-fe596b9aa1c4 None None] [instance: ffe1f07d-0a48-431d-be98-7e78018faa10] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fcb6379a-4c57-462b-a4ea-9680340a5137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0f85b78e-78c3-4e5a-a33d-ace04474a737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 7f99c350-1c4e-47e8-884a-e821b6dd83bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:39:38 user nova-compute[73067]: INFO nova.compute.manager [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Rescuing
Aug 16 10:39:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquired lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:39:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updating instance_info_cache with network_info: [{"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Releasing lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-ccf3c734-09ec-47c8-b321-c638203c1a68 req-c8a6e19a-ee0a-48be-9812-00eb8379b7b7 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-unplugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ccf3c734-09ec-47c8-b321-c638203c1a68 req-c8a6e19a-ee0a-48be-9812-00eb8379b7b7 service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ccf3c734-09ec-47c8-b321-c638203c1a68 req-c8a6e19a-ee0a-48be-9812-00eb8379b7b7 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ccf3c734-09ec-47c8-b321-c638203c1a68 req-c8a6e19a-ee0a-48be-9812-00eb8379b7b7 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-ccf3c734-09ec-47c8-b321-c638203c1a68 req-c8a6e19a-ee0a-48be-9812-00eb8379b7b7 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-unplugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:39:39 user nova-compute[73067]: WARNING nova.compute.manager [req-ccf3c734-09ec-47c8-b321-c638203c1a68 req-c8a6e19a-ee0a-48be-9812-00eb8379b7b7 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-unplugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state active and task_state rescuing.
Aug 16 10:39:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:40 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Instance destroyed successfully.
Aug 16 10:39:40 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Attempting a stable device rescue
Aug 16 10:39:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73067) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 10:39:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Instance directory exists: not creating {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 10:39:40 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Creating image(s)
Aug 16 10:39:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "/opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "/opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "/opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:40 user nova-compute[73067]: DEBUG nova.objects.instance [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'trusted_certs' on Instance uuid 57c883ce-680f-455e-b393-e8c82576d440 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:39:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "ddc0573da82372db8e8d9071f3fd0b16ea1f5b68" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "ddc0573da82372db8e8d9071f3fd0b16ea1f5b68" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68.part --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:41 user nova-compute[73067]: DEBUG nova.virt.images [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] abcbc0a0-3fdf-4755-9e90-3035308dacef was qcow2, converting to raw {{(pid=73067) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 10:39:41 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:39:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68.part /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68.converted {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-ebdf7c5a-f772-4d45-b339-55e440ba5062 req-55caf800-f668-43fe-ba60-da6960e86b8f service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:39:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ebdf7c5a-f772-4d45-b339-55e440ba5062 req-55caf800-f668-43fe-ba60-da6960e86b8f service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ebdf7c5a-f772-4d45-b339-55e440ba5062 req-55caf800-f668-43fe-ba60-da6960e86b8f service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ebdf7c5a-f772-4d45-b339-55e440ba5062 req-55caf800-f668-43fe-ba60-da6960e86b8f service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-ebdf7c5a-f772-4d45-b339-55e440ba5062 req-55caf800-f668-43fe-ba60-da6960e86b8f service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:39:41 user nova-compute[73067]: WARNING nova.compute.manager [req-ebdf7c5a-f772-4d45-b339-55e440ba5062 req-55caf800-f668-43fe-ba60-da6960e86b8f service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state active and task_state rescuing.
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68.part /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68.converted" returned: 0 in 0.702s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68.converted --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "ddc0573da82372db8e8d9071f3fd0b16ea1f5b68" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.282s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "ddc0573da82372db8e8d9071f3fd0b16ea1f5b68" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "ddc0573da82372db8e8d9071f3fd0b16ea1f5b68" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68 --force-share --output=json" returned: 0 in 0.211s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68,backing_fmt=raw /opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/disk.rescue {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68,backing_fmt=raw /opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/disk.rescue" returned: 0 in 0.055s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "ddc0573da82372db8e8d9071f3fd0b16ea1f5b68" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.objects.instance [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'migration_context' on Instance uuid 57c883ce-680f-455e-b393-e8c82576d440 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Start _get_guest_xml network_info=[{"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "vif_mac": "fa:16:3e:49:19:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'abcbc0a0-3fdf-4755-9e90-3035308dacef', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAPiGquj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '57c883ce-680f-455e-b393-e8c82576d440', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7b0ebfb-7ee6-46a6-8356-82d777e8a742', 'serial': 'b7b0ebfb-7ee6-46a6-8356-82d777e8a742'}, 'delete_on_termination': False, 'attachment_id': 'da703fe9-0991-4e95-9414-d6402693dc9d', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.objects.instance [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'resources' on Instance uuid 57c883ce-680f-455e-b393-e8c82576d440 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.objects.instance [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'numa_topology' on Instance uuid 57c883ce-680f-455e-b393-e8c82576d440 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:39:42 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:39:42 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.objects.instance [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57c883ce-680f-455e-b393-e8c82576d440 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAPiGquj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:39:42 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:39:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:39:42 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:39:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:39:42 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9950901-4162-415b-9734-e57e0844f054]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OAPiGquj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 10:39:42 user nova-compute[73067]: node.name = iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742
Aug 16 10:39:42 user nova-compute[73067]: node.tpgt = -1
Aug 16 10:39:42 user nova-compute[73067]: node.startup = automatic
Aug 16 10:39:42 user nova-compute[73067]: node.leading_login = No
Aug 16 10:39:42 user nova-compute[73067]: iface.iscsi_ifacename = default
Aug 16 10:39:42 user nova-compute[73067]: iface.net_ifacename = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.ipaddress = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.prefix_len = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.hwaddress = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.transport_name = tcp
Aug 16 10:39:42 user nova-compute[73067]: iface.initiatorname = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.state = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.vlan_id = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.vlan_priority = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.vlan_state = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.iface_num = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.mtu = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.port = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.bootproto = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.subnet_mask = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.gateway = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.dhcp_alt_client_id = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.dhcp_dns = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.dhcp_learn_iqn = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.dhcp_vendor_id_state = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.dhcp_vendor_id = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.dhcp_slp_da = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.fragmentation = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.gratuitous_arp = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.incoming_forwarding = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.tos_state = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.tos = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.ttl = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.delayed_ack = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.tcp_nagle = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.tcp_wsf_state = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.tcp_wsf = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.tcp_timer_scale = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.tcp_timestamp = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.redirect = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.def_task_mgmt_timeout = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.header_digest = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.data_digest = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.immediate_data = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.initial_r2t = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.data_seq_inorder = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.data_pdu_inorder = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.erl = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.max_receive_data_len = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.first_burst_len = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.max_outstanding_r2t = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.max_burst_len = 0
Aug 16 10:39:42 user nova-compute[73067]: iface.chap_auth = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.bidi_chap = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.strict_login_compliance = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.discovery_auth = <empty>
Aug 16 10:39:42 user nova-compute[73067]: iface.discovery_logout = <empty>
Aug 16 10:39:42 user nova-compute[73067]: node.discovery_address = <empty>
Aug 16 10:39:42 user nova-compute[73067]: node.discovery_port = 0
Aug 16 10:39:42 user nova-compute[73067]: node.discovery_type = static
Aug 16 10:39:42 user nova-compute[73067]: node.session.initial_cmdsn = 0
Aug 16 10:39:42 user nova-compute[73067]: node.session.initial_login_retry_max = 8
Aug 16 10:39:42 user nova-compute[73067]: node.session.xmit_thread_priority = -20
Aug 16 10:39:42 user nova-compute[73067]: node.session.cmds_max = 128
Aug 16 10:39:42 user nova-compute[73067]: node.session.queue_depth = 32
Aug 16 10:39:42 user nova-compute[73067]: node.session.nr_sessions = 1
Aug 16 10:39:42 user nova-compute[73067]: node.session.auth.authmethod = CHAP
Aug 16 10:39:42 user nova-compute[73067]: node.session.auth.username = OAPiGquj
Aug 16 10:39:42 user nova-compute[73067]: node.session.auth.password = ***
Aug 16 10:39:42 user nova-compute[73067]: node.session.auth.username_in = <empty>
Aug 16 10:39:42 user nova-compute[73067]: node.session.auth.password_in = <empty>
Aug 16 10:39:42 user nova-compute[73067]: node.session.auth.chap_algs = MD5
Aug 16 10:39:42 user nova-compute[73067]: node.session.timeo.replacement_timeout = 120
Aug 16 10:39:42 user nova-compute[73067]: node.session.err_timeo.abort_timeout = 15
Aug 16 10:39:42 user nova-compute[73067]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 10:39:42 user nova-compute[73067]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 10:39:42 user nova-compute[73067]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 10:39:42 user nova-compute[73067]: node.session.iscsi.FastAbort = Yes
Aug 16 10:39:42 user nova-compute[73067]: node.session.iscsi.InitialR2T = No
Aug 16 10:39:42 user nova-compute[73067]: node.session.iscsi.ImmediateData = Yes
Aug 16 10:39:42 user nova-compute[73067]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 10:39:42 user nova-compute[73067]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 10:39:42 user nova-compute[73067]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 10:39:42 user nova-compute[73067]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 10:39:42 user nova-compute[73067]: node.session.iscsi.MaxConnections = 1
Aug 16 10:39:42 user nova-compute[73067]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 10:39:42 user nova-compute[73067]: node.session.iscsi.ERL = 0
Aug 16 10:39:42 user nova-compute[73067]: node.session.scan = manual
Aug 16 10:39:42 user nova-compute[73067]: node.session.reopen_max = 0
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].address = 172.16.0.220
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].port = 3260
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].startup = manual
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].tcp.window_size = 524288
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].tcp.type_of_service = 0
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].timeo.logout_timeout = 15
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].timeo.login_timeout = 15
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].timeo.auth_timeout = 45
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].iscsi.DataDigest = None
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].iscsi.IFMarker = No
Aug 16 10:39:42 user nova-compute[73067]: node.conn[0].iscsi.OFMarker = No
Aug 16 10:39:42 user nova-compute[73067]: # END RECORD
Aug 16 10:39:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ee98c6-b1ff-479e-8d66-03febc03b1ca]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97bc223-f9e3-40f7-8030-67f802d111f5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAPiGquj {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAPiGquj" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f237ee-d796-4e3a-b82f-13e0d946210b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OAPiGquj'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdfa911-43ae-4046-9b6a-0866cc00ac82]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[420cd771-2ec2-4c22-99fc-079be6985c84]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:39:43 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:39:43 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:39:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:39:43 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:39:43 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:39:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] HCTL ('36', '0', '0', 0) found on session 26 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5511a156-885f-4c91-b6f4-e3e693216d0c]: (4, ('0 0 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching for a device in session 26 and hctl ('36', '0', '0', 0) yield: sde {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAPiGquj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '23266616234333063', 'path': '/dev/sde'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266616234333063', 'path': '/dev/sde'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1809056316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1809056316',id=24,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:38:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-ogv2vdn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:38:10Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=57c883ce-680f-455e-b393-e8c82576d440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "vif_mac": "fa:16:3e:49:19:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "vif_mac": "fa:16:3e:49:19:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=75d617b8-2a0f-40a6-9ac3-b22d3ce779f6,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d617b8-2a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'pci_devices' on Instance uuid 57c883ce-680f-455e-b393-e8c82576d440 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:39:43 user nova-compute[73067]:   <uuid>57c883ce-680f-455e-b393-e8c82576d440</uuid>
Aug 16 10:39:43 user nova-compute[73067]:   <name>instance-00000018</name>
Aug 16 10:39:43 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:39:43 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:39:43 user nova-compute[73067]:   <metadata>
Aug 16 10:39:43 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:39:43 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:39:43 user nova-compute[73067]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1809056316</nova:name>
Aug 16 10:39:43 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:39:42</nova:creationTime>
Aug 16 10:39:43 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:39:43 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:39:43 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:39:43 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:39:43 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:39:43 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:39:43 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:39:43 user nova-compute[73067]:       <nova:owner>
Aug 16 10:39:43 user nova-compute[73067]:         <nova:user uuid="d3b135edcf064595b8d93052903696a7">tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member</nova:user>
Aug 16 10:39:43 user nova-compute[73067]:         <nova:project uuid="4d03e64450654fd693d6a1bd43017880">tempest-ServerBootFromVolumeStableRescueTest-1973630968</nova:project>
Aug 16 10:39:43 user nova-compute[73067]:       </nova:owner>
Aug 16 10:39:43 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:39:43 user nova-compute[73067]:       <nova:ports>
Aug 16 10:39:43 user nova-compute[73067]:         <nova:port uuid="75d617b8-2a0f-40a6-9ac3-b22d3ce779f6">
Aug 16 10:39:43 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 10:39:43 user nova-compute[73067]:         </nova:port>
Aug 16 10:39:43 user nova-compute[73067]:       </nova:ports>
Aug 16 10:39:43 user nova-compute[73067]:     </nova:instance>
Aug 16 10:39:43 user nova-compute[73067]:   </metadata>
Aug 16 10:39:43 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:39:43 user nova-compute[73067]:     <system>
Aug 16 10:39:43 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:39:43 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:39:43 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:39:43 user nova-compute[73067]:       <entry name="serial">57c883ce-680f-455e-b393-e8c82576d440</entry>
Aug 16 10:39:43 user nova-compute[73067]:       <entry name="uuid">57c883ce-680f-455e-b393-e8c82576d440</entry>
Aug 16 10:39:43 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:39:43 user nova-compute[73067]:     </system>
Aug 16 10:39:43 user nova-compute[73067]:   </sysinfo>
Aug 16 10:39:43 user nova-compute[73067]:   <os>
Aug 16 10:39:43 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:39:43 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:39:43 user nova-compute[73067]:   </os>
Aug 16 10:39:43 user nova-compute[73067]:   <features>
Aug 16 10:39:43 user nova-compute[73067]:     <acpi/>
Aug 16 10:39:43 user nova-compute[73067]:     <apic/>
Aug 16 10:39:43 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:39:43 user nova-compute[73067]:   </features>
Aug 16 10:39:43 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:39:43 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:39:43 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:39:43 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:39:43 user nova-compute[73067]:   </clock>
Aug 16 10:39:43 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:39:43 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:39:43 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:39:43 user nova-compute[73067]:   </cpu>
Aug 16 10:39:43 user nova-compute[73067]:   <devices>
Aug 16 10:39:43 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:39:43 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:39:43 user nova-compute[73067]:       <source dev="/dev/sde"/>
Aug 16 10:39:43 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:39:43 user nova-compute[73067]:       <serial>b7b0ebfb-7ee6-46a6-8356-82d777e8a742</serial>
Aug 16 10:39:43 user nova-compute[73067]:     </disk>
Aug 16 10:39:43 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:39:43 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:39:43 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/disk.rescue"/>
Aug 16 10:39:43 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:39:43 user nova-compute[73067]:       <boot order="1"/>
Aug 16 10:39:43 user nova-compute[73067]:     </disk>
Aug 16 10:39:43 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:39:43 user nova-compute[73067]:       <mac address="fa:16:3e:49:19:c4"/>
Aug 16 10:39:43 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:39:43 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:39:43 user nova-compute[73067]:       <target dev="tap75d617b8-2a"/>
Aug 16 10:39:43 user nova-compute[73067]:     </interface>
Aug 16 10:39:43 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:39:43 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/console.log" append="off"/>
Aug 16 10:39:43 user nova-compute[73067]:     </serial>
Aug 16 10:39:43 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:39:43 user nova-compute[73067]:     <video>
Aug 16 10:39:43 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:39:43 user nova-compute[73067]:     </video>
Aug 16 10:39:43 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:39:43 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:39:43 user nova-compute[73067]:     </rng>
Aug 16 10:39:43 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:39:43 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:39:43 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:39:43 user nova-compute[73067]:     </memballoon>
Aug 16 10:39:43 user nova-compute[73067]:   </devices>
Aug 16 10:39:43 user nova-compute[73067]: </domain>
Aug 16 10:39:43 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:39:43 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Instance destroyed successfully.
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No VIF found with MAC fa:16:3e:49:19:c4, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:43 user nova-compute[73067]: INFO nova.compute.manager [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Detaching volume a4634a36-dbdd-4bcd-b251-ebf7021db0d1
Aug 16 10:39:43 user nova-compute[73067]: INFO nova.virt.block_device [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Attempting to driver detach volume a4634a36-dbdd-4bcd-b251-ebf7021db0d1 from mountpoint /dev/vdb
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Attempting to detach device vdb from instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:39:43 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:39:43 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 10:39:43 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:39:43 user nova-compute[73067]:   <serial>a4634a36-dbdd-4bcd-b251-ebf7021db0d1</serial>
Aug 16 10:39:43 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:39:43 user nova-compute[73067]: </disk>
Aug 16 10:39:43 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:39:43 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully detached device vdb from instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779 from the persistent domain config.
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:39:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:39:43 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:39:43 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 10:39:43 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:39:43 user nova-compute[73067]:   <serial>a4634a36-dbdd-4bcd-b251-ebf7021db0d1</serial>
Aug 16 10:39:43 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:39:43 user nova-compute[73067]: </disk>
Aug 16 10:39:43 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182384.4248474, 2448aa3f-a0a6-43c6-8844-dbfb8145d779 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:39:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully detached device vdb from instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779 from the live domain config.
Aug 16 10:39:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZxeWuCco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:39:44 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8873ff0-719f-40c9-8215-80a100228896]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[702312ca-3684-4b00-a607-acff2816e58a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:39:44 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:39:44 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:39:44 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 (non-flash)
Aug 16 10:39:44 user nova-compute[73067]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:39:44 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:39:44 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3564119fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1'): ({'sdd'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Removing single pathed devices sdd {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e541b96-3e3e-4586-ad1f-ffe29308d368]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c2e5e4-cf62-495f-a16d-24639059b8fb]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flushing IO for device /dev/sdd {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd5ef1e-ea6d-48e7-ba59-8f81fbdadd47]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bcd585-d3b0-4d4d-88ec-8084799e623c]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6112c4-9886-4b9b-aa1c-de4c9f52b655]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2199a989-d7b0-4e0a-a7ba-b135e9b65084]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1, portal: 172.16.0.220,3260]
Aug 16 10:39:44 user nova-compute[73067]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1, portal: 172.16.0.220,3260] successful.
Aug 16 10:39:44 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4634a36-dbdd-4bcd-b251-ebf7021db0d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[df90735c-590a-44b6-8cfd-e448c927e950]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] <== disconnect_volume: return (290ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-79ada1b1-3c57-4adf-aad3-5774988d9a79 req-8fad9ca9-9a9d-4e39-b095-6a292b9c9fd0 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:39:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79ada1b1-3c57-4adf-aad3-5774988d9a79 req-8fad9ca9-9a9d-4e39-b095-6a292b9c9fd0 service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79ada1b1-3c57-4adf-aad3-5774988d9a79 req-8fad9ca9-9a9d-4e39-b095-6a292b9c9fd0 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-79ada1b1-3c57-4adf-aad3-5774988d9a79 req-8fad9ca9-9a9d-4e39-b095-6a292b9c9fd0 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-79ada1b1-3c57-4adf-aad3-5774988d9a79 req-8fad9ca9-9a9d-4e39-b095-6a292b9c9fd0 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:39:45 user nova-compute[73067]: WARNING nova.compute.manager [req-79ada1b1-3c57-4adf-aad3-5774988d9a79 req-8fad9ca9-9a9d-4e39-b095-6a292b9c9fd0 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state active and task_state rescuing.
Aug 16 10:39:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:47 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for 57c883ce-680f-455e-b393-e8c82576d440 due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:39:47 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182387.0555663, 57c883ce-680f-455e-b393-e8c82576d440 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:39:47 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] VM Resumed (Lifecycle Event)
Aug 16 10:39:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7d70a40c-c4a3-4924-842f-9aaabb18a544 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:39:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:39:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:39:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-97843b47-a1cd-4f36-bef3-1a55bca2acad req-e9a11b0b-c031-4c92-816c-54fb6524b917 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:39:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-97843b47-a1cd-4f36-bef3-1a55bca2acad req-e9a11b0b-c031-4c92-816c-54fb6524b917 service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:39:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-97843b47-a1cd-4f36-bef3-1a55bca2acad req-e9a11b0b-c031-4c92-816c-54fb6524b917 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:39:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-97843b47-a1cd-4f36-bef3-1a55bca2acad req-e9a11b0b-c031-4c92-816c-54fb6524b917 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-97843b47-a1cd-4f36-bef3-1a55bca2acad req-e9a11b0b-c031-4c92-816c-54fb6524b917 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:39:47 user nova-compute[73067]: WARNING nova.compute.manager [req-97843b47-a1cd-4f36-bef3-1a55bca2acad req-e9a11b0b-c031-4c92-816c-54fb6524b917 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state active and task_state rescuing.
Aug 16 10:39:47 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 10:39:47 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182387.057478, 57c883ce-680f-455e-b393-e8c82576d440 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:39:47 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] VM Started (Lifecycle Event)
Aug 16 10:39:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:39:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:39:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:51 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'flavor' on Instance uuid 2448aa3f-a0a6-43c6-8844-dbfb8145d779 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:39:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5ec48468-0cba-42de-ba71-7238d6b9d1cf tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.788s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:39:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:39:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:39:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:39:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:39:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:39:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:39:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-1abd4267-eef5-4635-a342-bf25252dbf74 req-abf39550-5902-4fae-962b-15d7b3cbe8fb service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-changed-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-1abd4267-eef5-4635-a342-bf25252dbf74 req-abf39550-5902-4fae-962b-15d7b3cbe8fb service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Refreshing instance network info cache due to event network-changed-9aec1f71-9229-4e37-b633-b2204d7a4484. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:40:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1abd4267-eef5-4635-a342-bf25252dbf74 req-abf39550-5902-4fae-962b-15d7b3cbe8fb service nova] Acquiring lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:40:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1abd4267-eef5-4635-a342-bf25252dbf74 req-abf39550-5902-4fae-962b-15d7b3cbe8fb service nova] Acquired lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:40:06 user nova-compute[73067]: DEBUG nova.network.neutron [req-1abd4267-eef5-4635-a342-bf25252dbf74 req-abf39550-5902-4fae-962b-15d7b3cbe8fb service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Refreshing network info cache for port 9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:40:07 user nova-compute[73067]: DEBUG nova.network.neutron [req-1abd4267-eef5-4635-a342-bf25252dbf74 req-abf39550-5902-4fae-962b-15d7b3cbe8fb service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updated VIF entry in instance network info cache for port 9aec1f71-9229-4e37-b633-b2204d7a4484. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:40:07 user nova-compute[73067]: DEBUG nova.network.neutron [req-1abd4267-eef5-4635-a342-bf25252dbf74 req-abf39550-5902-4fae-962b-15d7b3cbe8fb service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updating instance_info_cache with network_info: [{"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:40:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1abd4267-eef5-4635-a342-bf25252dbf74 req-abf39550-5902-4fae-962b-15d7b3cbe8fb service nova] Releasing lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:40:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:12 user nova-compute[73067]: INFO nova.compute.manager [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Shelving
Aug 16 10:40:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:13 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance destroyed successfully.
Aug 16 10:40:13 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Beginning cold snapshot process
Aug 16 10:40:13 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:40:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk /opt/stack/data/nova/instances/snapshots/tmppkeqk1vt/12116d200b3c4de28cced2c845f86835 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:14 user nova-compute[73067]: DEBUG nova.compute.manager [req-1e513dd4-3373-44f4-bd65-f3dbf1695a0e req-ec663dfe-9f61-4bd4-b8da-d3f2dec748bc service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-vif-unplugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e513dd4-3373-44f4-bd65-f3dbf1695a0e req-ec663dfe-9f61-4bd4-b8da-d3f2dec748bc service nova] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e513dd4-3373-44f4-bd65-f3dbf1695a0e req-ec663dfe-9f61-4bd4-b8da-d3f2dec748bc service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e513dd4-3373-44f4-bd65-f3dbf1695a0e req-ec663dfe-9f61-4bd4-b8da-d3f2dec748bc service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:14 user nova-compute[73067]: DEBUG nova.compute.manager [req-1e513dd4-3373-44f4-bd65-f3dbf1695a0e req-ec663dfe-9f61-4bd4-b8da-d3f2dec748bc service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] No waiting events found dispatching network-vif-unplugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:40:14 user nova-compute[73067]: WARNING nova.compute.manager [req-1e513dd4-3373-44f4-bd65-f3dbf1695a0e req-ec663dfe-9f61-4bd4-b8da-d3f2dec748bc service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received unexpected event network-vif-unplugged-9aec1f71-9229-4e37-b633-b2204d7a4484 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 16 10:40:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk /opt/stack/data/nova/instances/snapshots/tmppkeqk1vt/12116d200b3c4de28cced2c845f86835" returned: 0 in 1.011s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:14 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Snapshot extracted, beginning image upload
Aug 16 10:40:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-c26f2b43-6423-4392-a104-a23cec2ca1db req-85656c3a-6da4-4a87-8ded-6e61f284f3ab service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c26f2b43-6423-4392-a104-a23cec2ca1db req-85656c3a-6da4-4a87-8ded-6e61f284f3ab service nova] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c26f2b43-6423-4392-a104-a23cec2ca1db req-85656c3a-6da4-4a87-8ded-6e61f284f3ab service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c26f2b43-6423-4392-a104-a23cec2ca1db req-85656c3a-6da4-4a87-8ded-6e61f284f3ab service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-c26f2b43-6423-4392-a104-a23cec2ca1db req-85656c3a-6da4-4a87-8ded-6e61f284f3ab service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] No waiting events found dispatching network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:40:16 user nova-compute[73067]: WARNING nova.compute.manager [req-c26f2b43-6423-4392-a104-a23cec2ca1db req-85656c3a-6da4-4a87-8ded-6e61f284f3ab service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received unexpected event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 10:40:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:17 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Snapshot image upload complete
Aug 16 10:40:17 user nova-compute[73067]: DEBUG nova.compute.manager [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:40:17 user nova-compute[73067]: INFO nova.compute.manager [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Shelve offloading
Aug 16 10:40:17 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance destroyed successfully.
Aug 16 10:40:17 user nova-compute[73067]: DEBUG nova.compute.manager [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:40:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:40:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquired lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:40:17 user nova-compute[73067]: DEBUG nova.network.neutron [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG nova.network.neutron [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updating instance_info_cache with network_info: [{"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Releasing lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:40:18 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance destroyed successfully.
Aug 16 10:40:18 user nova-compute[73067]: DEBUG nova.objects.instance [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'resources' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1846221895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1846221895',id=25,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQLeVJ9+VvVaQoNonbC1P2yB/UFcdPrlEtelI4nMnb6bicCGLgiVAtuSX8tNWkXxMJWyAVCENVhakwG4a4lJBnM4M+Mek/Dn7aiiBJzoKdLv41kQKbVz5WyipYM4S5xyQ==',key_name='tempest-keypair-917872012',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:38:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-hbj32uf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member',shelved_at='2023-08-16T10:40:17.429626',shelved_host='user',shelved_image_id='a75331ca-7540-4048-a292-237a7f49cf79'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:40:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=4b3c2355-eee1-4a0f-bebc-9425ec85aac4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG os_vif [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9aec1f71-92, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:40:18 user nova-compute[73067]: INFO os_vif [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92')
Aug 16 10:40:18 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Deleting instance files /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4_del
Aug 16 10:40:18 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Deletion of /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4_del complete
Aug 16 10:40:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-df512793-d6da-4c45-9cad-38e9c47eaed4 req-43caeb33-e871-46a3-8b0e-120364c98e73 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-changed-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-df512793-d6da-4c45-9cad-38e9c47eaed4 req-43caeb33-e871-46a3-8b0e-120364c98e73 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Refreshing instance network info cache due to event network-changed-9aec1f71-9229-4e37-b633-b2204d7a4484. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-df512793-d6da-4c45-9cad-38e9c47eaed4 req-43caeb33-e871-46a3-8b0e-120364c98e73 service nova] Acquiring lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-df512793-d6da-4c45-9cad-38e9c47eaed4 req-43caeb33-e871-46a3-8b0e-120364c98e73 service nova] Acquired lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:40:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-df512793-d6da-4c45-9cad-38e9c47eaed4 req-43caeb33-e871-46a3-8b0e-120364c98e73 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Refreshing network info cache for port 9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:40:19 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Deleted allocations for instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4
Aug 16 10:40:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:19 user nova-compute[73067]: DEBUG nova.objects.instance [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:19 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:40:19 user nova-compute[73067]: DEBUG nova.network.neutron [req-df512793-d6da-4c45-9cad-38e9c47eaed4 req-43caeb33-e871-46a3-8b0e-120364c98e73 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updated VIF entry in instance network info cache for port 9aec1f71-9229-4e37-b633-b2204d7a4484. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:40:19 user nova-compute[73067]: DEBUG nova.network.neutron [req-df512793-d6da-4c45-9cad-38e9c47eaed4 req-43caeb33-e871-46a3-8b0e-120364c98e73 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updating instance_info_cache with network_info: [{"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9aec1f71-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:40:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:40:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-df512793-d6da-4c45-9cad-38e9c47eaed4 req-43caeb33-e871-46a3-8b0e-120364c98e73 service nova] Releasing lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:40:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43de652e-8373-4438-9aa1-cd7a66bc81b6 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.853s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-e527e33a-bf04-4ea4-aa69-73a8e1670677 req-d6484da0-e3a4-4058-987d-b60891151b7a service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received event network-changed-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-e527e33a-bf04-4ea4-aa69-73a8e1670677 req-d6484da0-e3a4-4058-987d-b60891151b7a service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Refreshing instance network info cache due to event network-changed-428c8372-75c3-4d2d-a626-41a1bc868f2f. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e527e33a-bf04-4ea4-aa69-73a8e1670677 req-d6484da0-e3a4-4058-987d-b60891151b7a service nova] Acquiring lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e527e33a-bf04-4ea4-aa69-73a8e1670677 req-d6484da0-e3a4-4058-987d-b60891151b7a service nova] Acquired lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-e527e33a-bf04-4ea4-aa69-73a8e1670677 req-d6484da0-e3a4-4058-987d-b60891151b7a service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Refreshing network info cache for port 428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG nova.objects.instance [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'flavor' on Instance uuid 7f99c350-1c4e-47e8-884a-e821b6dd83bc {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-e527e33a-bf04-4ea4-aa69-73a8e1670677 req-d6484da0-e3a4-4058-987d-b60891151b7a service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Updated VIF entry in instance network info cache for port 428c8372-75c3-4d2d-a626-41a1bc868f2f. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-e527e33a-bf04-4ea4-aa69-73a8e1670677 req-d6484da0-e3a4-4058-987d-b60891151b7a service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Updating instance_info_cache with network_info: [{"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e527e33a-bf04-4ea4-aa69-73a8e1670677 req-d6484da0-e3a4-4058-987d-b60891151b7a service nova] Releasing lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:20 user nova-compute[73067]: INFO nova.compute.manager [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Attaching volume 736b2128-048f-405a-b3fb-43193092f987 to /dev/vdb
Aug 16 10:40:20 user nova-compute[73067]: DEBUG os_brick.utils [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7d5296-673f-4701-b7fa-8558d54a3b34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[124c3a9b-b182-41a9-8c6c-c43f522a745b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7f8aa2-e42f-452b-b0e9-81a637afda3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[482b3434-ab04-41b1-b480-4e0b653c8e6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:40:20 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:40:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c359004-1652-412a-a4d6-7594c96da119]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG os_brick.utils [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:40:20 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Updating existing volume attachment record: abee0677-5559-4d31-bca8-d727253605c8 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:40:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:28 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182413.4852154, 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:40:28 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] VM Stopped (Lifecycle Event)
Aug 16 10:40:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4059ead3-e732-45df-b780-a6379c07b5c3 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:40:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyrYmbfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:40:31 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:40:31 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:40:31 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ed29a3-8c58-45b4-86d6-8a066c36a222]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:40:31 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3834a4-30c5-4f4b-bf03-3d98d713149d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987] added
Aug 16 10:40:31 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6913c129-94f5-4ddc-b35d-42cf8404e499]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[81309bdf-add9-4309-8718-941b6e9477a0]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyrYmbfA {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyrYmbfA" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9130e235-1c88-468d-ae3c-a6b35aa3066b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IyrYmbfA'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50b7dc1-e3f8-4105-8c87-cd0cf8b4807b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaff50e3-fb8c-404f-a7bb-86b549b3e64b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:40:31 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:40:31 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:40:31 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:40:31 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:40:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1775943c-f508-44eb-99f5-3ec9801e47c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987, portal: 172.16.0.220,3260]
Aug 16 10:40:32 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987, portal: 172.16.0.220,3260] successful.
Aug 16 10:40:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[211c53b7-8e7f-4e02-a3a6-56ce539f540e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[290a032d-919f-4260-91c9-80e55f13e7fd]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:40:32 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:40:32 user nova-compute[73067]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 (non-flash)
Aug 16 10:40:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:40:32 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:40:32 user nova-compute[73067]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 (non-flash)
Aug 16 10:40:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e8be6-0adf-4953-9785-a476f104e26e]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:40:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyrYmbfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23861363334303063', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861363334303063', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'flavor' on Instance uuid 7f99c350-1c4e-47e8-884a-e821b6dd83bc {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:40:33 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:40:33 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:40:33 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:40:33 user nova-compute[73067]:   <serial>736b2128-048f-405a-b3fb-43193092f987</serial>
Aug 16 10:40:33 user nova-compute[73067]: </disk>
Aug 16 10:40:33 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] No VIF found with MAC fa:16:3e:d5:b2:5c, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updating instance_info_cache with network_info: [{"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-92ff657b-4dd0-4d7a-af77-189145acb60d tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.167s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:34 user nova-compute[73067]: INFO nova.compute.manager [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Terminating instance
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-48b0dcbb-4aba-403a-8723-6d3c8148085e req-2f755160-d7a8-4111-bf04-f290271e9ed3 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received event network-vif-unplugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-48b0dcbb-4aba-403a-8723-6d3c8148085e req-2f755160-d7a8-4111-bf04-f290271e9ed3 service nova] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-48b0dcbb-4aba-403a-8723-6d3c8148085e req-2f755160-d7a8-4111-bf04-f290271e9ed3 service nova] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-48b0dcbb-4aba-403a-8723-6d3c8148085e req-2f755160-d7a8-4111-bf04-f290271e9ed3 service nova] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-48b0dcbb-4aba-403a-8723-6d3c8148085e req-2f755160-d7a8-4111-bf04-f290271e9ed3 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] No waiting events found dispatching network-vif-unplugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-48b0dcbb-4aba-403a-8723-6d3c8148085e req-2f755160-d7a8-4111-bf04-f290271e9ed3 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received event network-vif-unplugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:40:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Instance destroyed successfully.
Aug 16 10:40:34 user nova-compute[73067]: DEBUG nova.objects.instance [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'resources' on Instance uuid 2448aa3f-a0a6-43c6-8844-dbfb8145d779 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1884560080',display_name='tempest-AttachVolumeNegativeTest-server-1884560080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1884560080',id=18,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRN+t+EoHP67fhfeMSFGoswweiFsS03ZZwJDwBe7aC5BOqV+MymEmmAqtSDZxJFTsM3PMTtPGDUEf/9PcFo7R54kr9NOczPbdigkMQnXYD1TnEoA7NIm2cTFVUVsoF4gQ==',key_name='tempest-keypair-1298336385',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:34:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-0pqgplmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=2448aa3f-a0a6-43c6-8844-dbfb8145d779,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "address": "fa:16:3e:ae:d4:32", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ba3836-05", "ovs_interfaceid": "23ba3836-0532-4a97-aa9c-2fdbf6cbef26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d4:32,bridge_name='br-int',has_traffic_filtering=True,id=23ba3836-0532-4a97-aa9c-2fdbf6cbef26,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ba3836-05') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG os_vif [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d4:32,bridge_name='br-int',has_traffic_filtering=True,id=23ba3836-0532-4a97-aa9c-2fdbf6cbef26,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ba3836-05') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23ba3836-05, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:40:34 user nova-compute[73067]: INFO os_vif [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d4:32,bridge_name='br-int',has_traffic_filtering=True,id=23ba3836-0532-4a97-aa9c-2fdbf6cbef26,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ba3836-05')
Aug 16 10:40:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Deleting instance files /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779_del
Aug 16 10:40:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Deletion of /opt/stack/data/nova/instances/2448aa3f-a0a6-43c6-8844-dbfb8145d779_del complete
Aug 16 10:40:35 user nova-compute[73067]: INFO nova.compute.manager [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 10:40:35 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:40:35 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:40:35 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:40:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:40:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:35 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid '2448aa3f-a0a6-43c6-8844-dbfb8145d779' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid '2448aa3f-a0a6-43c6-8844-dbfb8145d779' (instance-00000012)
Aug 16 10:40:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:40:36 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Took 1.36 seconds to deallocate network for instance.
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:36 user nova-compute[73067]: INFO nova.compute.manager [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Detaching volume 736b2128-048f-405a-b3fb-43193092f987
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:36 user nova-compute[73067]: INFO nova.virt.block_device [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Attempting to driver detach volume 736b2128-048f-405a-b3fb-43193092f987 from mountpoint /dev/vdb
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Attempting to detach device vdb from instance 7f99c350-1c4e-47e8-884a-e821b6dd83bc from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:40:36 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:40:36 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:40:36 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:40:36 user nova-compute[73067]:   <serial>736b2128-048f-405a-b3fb-43193092f987</serial>
Aug 16 10:40:36 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:40:36 user nova-compute[73067]: </disk>
Aug 16 10:40:36 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:36 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Successfully detached device vdb from instance 7f99c350-1c4e-47e8-884a-e821b6dd83bc from the persistent domain config.
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f99c350-1c4e-47e8-884a-e821b6dd83bc from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:40:36 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:40:36 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:40:36 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:40:36 user nova-compute[73067]:   <serial>736b2128-048f-405a-b3fb-43193092f987</serial>
Aug 16 10:40:36 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:40:36 user nova-compute[73067]: </disk>
Aug 16 10:40:36 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-3fa2f7ef-a069-4172-ab1a-efa817be2922 req-bb76367a-7f83-4053-a464-857657940c79 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received event network-vif-plugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3fa2f7ef-a069-4172-ab1a-efa817be2922 req-bb76367a-7f83-4053-a464-857657940c79 service nova] Acquiring lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3fa2f7ef-a069-4172-ab1a-efa817be2922 req-bb76367a-7f83-4053-a464-857657940c79 service nova] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3fa2f7ef-a069-4172-ab1a-efa817be2922 req-bb76367a-7f83-4053-a464-857657940c79 service nova] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-3fa2f7ef-a069-4172-ab1a-efa817be2922 req-bb76367a-7f83-4053-a464-857657940c79 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] No waiting events found dispatching network-vif-plugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:40:36 user nova-compute[73067]: WARNING nova.compute.manager [req-3fa2f7ef-a069-4172-ab1a-efa817be2922 req-bb76367a-7f83-4053-a464-857657940c79 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received unexpected event network-vif-plugged-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 for instance with vm_state deleted and task_state None.
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-3fa2f7ef-a069-4172-ab1a-efa817be2922 req-bb76367a-7f83-4053-a464-857657940c79 service nova] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Received event network-vif-deleted-23ba3836-0532-4a97-aa9c-2fdbf6cbef26 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Deleted allocations for instance 2448aa3f-a0a6-43c6-8844-dbfb8145d779
Aug 16 10:40:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182437.039052, 7f99c350-1c4e-47e8-884a-e821b6dd83bc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f99c350-1c4e-47e8-884a-e821b6dd83bc {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:40:37 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Successfully detached device vdb from instance 7f99c350-1c4e-47e8-884a-e821b6dd83bc from the live domain config.
Aug 16 10:40:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyrYmbfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:40:37 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02a7241-21b0-4ae1-903b-57bc28843cfc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b321484a-2064-4ba3-8c63-c49f0e0dd366]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:40:37 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:40:37 user nova-compute[73067]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 (non-flash)
Aug 16 10:40:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:40:37 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:40:37 user nova-compute[73067]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 (non-flash)
Aug 16 10:40:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35447c7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb82682-162a-4951-b47f-39f73d9dea21]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-43744b74-24b5-4ab9-a873-060dfc0fdb63 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "2448aa3f-a0a6-43c6-8844-dbfb8145d779" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.113s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82e7174-e7c3-43d8-91b3-350f8f1305f8]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f375388-00a8-4fbc-b15a-5dfd40ab5bff]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabdf1df-ada7-4e42-b993-c030103fd2b1]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2017ce-c9d0-4bad-b499-ec0cd95ceb03]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2927af8-feb8-4d78-9255-b0232950d726]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987, portal: 172.16.0.220,3260]
Aug 16 10:40:37 user nova-compute[73067]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987, portal: 172.16.0.220,3260] successful.
Aug 16 10:40:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736b2128-048f-405a-b3fb-43193092f987 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac9fd58-7aff-4c33-bd68-6ce64a080baa]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] <== disconnect_volume: return (386ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:38 user nova-compute[73067]: DEBUG nova.objects.instance [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'flavor' on Instance uuid 7f99c350-1c4e-47e8-884a-e821b6dd83bc {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-6a71eb17-f03a-415c-833b-aa700ef90821 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.102s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:40:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7536MB free_disk=25.14740753173828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fcb6379a-4c57-462b-a4ea-9680340a5137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0f85b78e-78c3-4e5a-a33d-ace04474a737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 7f99c350-1c4e-47e8-884a-e821b6dd83bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:40 user nova-compute[73067]: INFO nova.compute.manager [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Rescuing
Aug 16 10:40:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:40:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquired lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:40:40 user nova-compute[73067]: DEBUG nova.network.neutron [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:40:40 user nova-compute[73067]: DEBUG nova.network.neutron [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Updating instance_info_cache with network_info: [{"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:40:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Releasing lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-ef04eb99-0e56-4b33-83d6-e9a710d609a6 req-67ad6899-a691-4bba-b69d-55732208b9ee service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-vif-unplugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ef04eb99-0e56-4b33-83d6-e9a710d609a6 req-67ad6899-a691-4bba-b69d-55732208b9ee service nova] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ef04eb99-0e56-4b33-83d6-e9a710d609a6 req-67ad6899-a691-4bba-b69d-55732208b9ee service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ef04eb99-0e56-4b33-83d6-e9a710d609a6 req-67ad6899-a691-4bba-b69d-55732208b9ee service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-ef04eb99-0e56-4b33-83d6-e9a710d609a6 req-67ad6899-a691-4bba-b69d-55732208b9ee service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] No waiting events found dispatching network-vif-unplugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:40:41 user nova-compute[73067]: WARNING nova.compute.manager [req-ef04eb99-0e56-4b33-83d6-e9a710d609a6 req-67ad6899-a691-4bba-b69d-55732208b9ee service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received unexpected event network-vif-unplugged-b466c179-fedb-44c5-84db-52a28279e32c for instance with vm_state active and task_state rescuing.
Aug 16 10:40:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Instance destroyed successfully.
Aug 16 10:40:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Attempting rescue
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73067) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Instance directory exists: not creating {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 10:40:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Creating image(s)
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'trusted_certs' on Instance uuid f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue" returned: 0 in 0.054s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'migration_context' on Instance uuid f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Start _get_guest_xml network_info=[{"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "vif_mac": "fa:16:3e:91:ac:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'resources' on Instance uuid f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'numa_topology' on Instance uuid f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:41 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:40:41 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:40:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'vcpu_model' on Instance uuid f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1969020103',display_name='tempest-ServerRescueNegativeTestJSON-server-1969020103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1969020103',id=28,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:38:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-4faijbkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:39:00Z,user_data=None,user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "vif_mac": "fa:16:3e:91:ac:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:40:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "vif_mac": "fa:16:3e:91:ac:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:40:42 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=b466c179-fedb-44c5-84db-52a28279e32c,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb466c179-fe') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:40:42 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'pci_devices' on Instance uuid f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:40:42 user nova-compute[73067]:   <uuid>f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7</uuid>
Aug 16 10:40:42 user nova-compute[73067]:   <name>instance-0000001c</name>
Aug 16 10:40:42 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:40:42 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:40:42 user nova-compute[73067]:   <metadata>
Aug 16 10:40:42 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:40:42 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:40:42 user nova-compute[73067]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1969020103</nova:name>
Aug 16 10:40:42 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:40:41</nova:creationTime>
Aug 16 10:40:42 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:40:42 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:40:42 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:40:42 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:40:42 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:40:42 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:40:42 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:40:42 user nova-compute[73067]:       <nova:owner>
Aug 16 10:40:42 user nova-compute[73067]:         <nova:user uuid="735a6aba3e974eb29e45ec3a7aa8c5cc">tempest-ServerRescueNegativeTestJSON-411494625-project-member</nova:user>
Aug 16 10:40:42 user nova-compute[73067]:         <nova:project uuid="687a889259b948fa985ce7c9b84b030a">tempest-ServerRescueNegativeTestJSON-411494625</nova:project>
Aug 16 10:40:42 user nova-compute[73067]:       </nova:owner>
Aug 16 10:40:42 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:40:42 user nova-compute[73067]:       <nova:ports>
Aug 16 10:40:42 user nova-compute[73067]:         <nova:port uuid="b466c179-fedb-44c5-84db-52a28279e32c">
Aug 16 10:40:42 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 10:40:42 user nova-compute[73067]:         </nova:port>
Aug 16 10:40:42 user nova-compute[73067]:       </nova:ports>
Aug 16 10:40:42 user nova-compute[73067]:     </nova:instance>
Aug 16 10:40:42 user nova-compute[73067]:   </metadata>
Aug 16 10:40:42 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:40:42 user nova-compute[73067]:     <system>
Aug 16 10:40:42 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:40:42 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:40:42 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:40:42 user nova-compute[73067]:       <entry name="serial">f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7</entry>
Aug 16 10:40:42 user nova-compute[73067]:       <entry name="uuid">f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7</entry>
Aug 16 10:40:42 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:40:42 user nova-compute[73067]:     </system>
Aug 16 10:40:42 user nova-compute[73067]:   </sysinfo>
Aug 16 10:40:42 user nova-compute[73067]:   <os>
Aug 16 10:40:42 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:40:42 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:40:42 user nova-compute[73067]:   </os>
Aug 16 10:40:42 user nova-compute[73067]:   <features>
Aug 16 10:40:42 user nova-compute[73067]:     <acpi/>
Aug 16 10:40:42 user nova-compute[73067]:     <apic/>
Aug 16 10:40:42 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:40:42 user nova-compute[73067]:   </features>
Aug 16 10:40:42 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:40:42 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:40:42 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:40:42 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:40:42 user nova-compute[73067]:   </clock>
Aug 16 10:40:42 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:40:42 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:40:42 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:40:42 user nova-compute[73067]:   </cpu>
Aug 16 10:40:42 user nova-compute[73067]:   <devices>
Aug 16 10:40:42 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:40:42 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:40:42 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue"/>
Aug 16 10:40:42 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:40:42 user nova-compute[73067]:     </disk>
Aug 16 10:40:42 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:40:42 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:40:42 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk"/>
Aug 16 10:40:42 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:40:42 user nova-compute[73067]:     </disk>
Aug 16 10:40:42 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:40:42 user nova-compute[73067]:       <mac address="fa:16:3e:91:ac:12"/>
Aug 16 10:40:42 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:40:42 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:40:42 user nova-compute[73067]:       <target dev="tapb466c179-fe"/>
Aug 16 10:40:42 user nova-compute[73067]:     </interface>
Aug 16 10:40:42 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:40:42 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/console.log" append="off"/>
Aug 16 10:40:42 user nova-compute[73067]:     </serial>
Aug 16 10:40:42 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:40:42 user nova-compute[73067]:     <video>
Aug 16 10:40:42 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:40:42 user nova-compute[73067]:     </video>
Aug 16 10:40:42 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:40:42 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:40:42 user nova-compute[73067]:     </rng>
Aug 16 10:40:42 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:40:42 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:40:42 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:40:42 user nova-compute[73067]:     </memballoon>
Aug 16 10:40:42 user nova-compute[73067]:   </devices>
Aug 16 10:40:42 user nova-compute[73067]: </domain>
Aug 16 10:40:42 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:40:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Instance destroyed successfully.
Aug 16 10:40:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:40:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:40:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No VIF found with MAC fa:16:3e:91:ac:12, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:40:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-1fa62298-e514-4a64-880d-96228b382735 req-b889c08f-ad38-40ce-a876-7b57a03bc66b service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1fa62298-e514-4a64-880d-96228b382735 req-b889c08f-ad38-40ce-a876-7b57a03bc66b service nova] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1fa62298-e514-4a64-880d-96228b382735 req-b889c08f-ad38-40ce-a876-7b57a03bc66b service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1fa62298-e514-4a64-880d-96228b382735 req-b889c08f-ad38-40ce-a876-7b57a03bc66b service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-1fa62298-e514-4a64-880d-96228b382735 req-b889c08f-ad38-40ce-a876-7b57a03bc66b service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] No waiting events found dispatching network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:40:43 user nova-compute[73067]: WARNING nova.compute.manager [req-1fa62298-e514-4a64-880d-96228b382735 req-b889c08f-ad38-40ce-a876-7b57a03bc66b service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received unexpected event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c for instance with vm_state active and task_state rescuing.
Aug 16 10:40:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] No waiting events found dispatching network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:40:45 user nova-compute[73067]: WARNING nova.compute.manager [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received unexpected event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c for instance with vm_state active and task_state rescuing.
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] No waiting events found dispatching network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:40:45 user nova-compute[73067]: WARNING nova.compute.manager [req-9aef1d77-62fc-4397-b2df-19bb68e88705 req-4f52cd52-84fb-42eb-8bb5-40255fac99ce service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received unexpected event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c for instance with vm_state active and task_state rescuing.
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182445.6618059, f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:40:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] VM Resumed (Lifecycle Event)
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-3e7b6bd9-aa38-4542-8344-eba8e51d0f20 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:40:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182445.6635745, f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:40:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] VM Started (Lifecycle Event)
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:40:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:40:46 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:40:46 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 10:40:46 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 10:40:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:48 user nova-compute[73067]: INFO nova.compute.manager [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Terminating instance
Aug 16 10:40:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-377c60a7-6114-468b-9266-29b780ab259a req-56a00d69-196a-41f1-9a20-65c8ef0f8e7e service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received event network-vif-unplugged-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-377c60a7-6114-468b-9266-29b780ab259a req-56a00d69-196a-41f1-9a20-65c8ef0f8e7e service nova] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-377c60a7-6114-468b-9266-29b780ab259a req-56a00d69-196a-41f1-9a20-65c8ef0f8e7e service nova] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-377c60a7-6114-468b-9266-29b780ab259a req-56a00d69-196a-41f1-9a20-65c8ef0f8e7e service nova] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-377c60a7-6114-468b-9266-29b780ab259a req-56a00d69-196a-41f1-9a20-65c8ef0f8e7e service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] No waiting events found dispatching network-vif-unplugged-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:40:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-377c60a7-6114-468b-9266-29b780ab259a req-56a00d69-196a-41f1-9a20-65c8ef0f8e7e service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received event network-vif-unplugged-b72f8a84-e264-4da0-b7da-0ab8750b046a for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:40:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Instance destroyed successfully.
Aug 16 10:40:49 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lazy-loading 'resources' on Instance uuid 0f85b78e-78c3-4e5a-a33d-ace04474a737 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1026129227',display_name='tempest-TestVolumeSwap-server-1026129227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1026129227',id=21,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWenRzgcPaYxFS7ODvS2pu0Ffqc8vamYfRa1ZYUknjgNhOzeFmelfh0JP8oDceVdIHJOY+9fEe9DYm56PCYFah7ZUzTCS1Se4H144dV9hgS3fIa6TfzgqbgAR6qM68ddw==',key_name='tempest-keypair-1931619155',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d02fb79aa19c4aeea8a34020239ff480',ramdisk_id='',reservation_id='r-4j1su4fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-690063517',owner_user_name='tempest-TestVolumeSwap-690063517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f31fb1d402eb4b20a235bde81abf368a',uuid=0f85b78e-78c3-4e5a-a33d-ace04474a737,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Converting VIF {"id": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "address": "fa:16:3e:45:38:13", "network": {"id": "51197f16-755c-4fca-a0a8-75bf5b5444ac", "bridge": "br-int", "label": "tempest-TestVolumeSwap-56884079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02fb79aa19c4aeea8a34020239ff480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72f8a84-e2", "ovs_interfaceid": "b72f8a84-e264-4da0-b7da-0ab8750b046a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:38:13,bridge_name='br-int',has_traffic_filtering=True,id=b72f8a84-e264-4da0-b7da-0ab8750b046a,network=Network(51197f16-755c-4fca-a0a8-75bf5b5444ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72f8a84-e2') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_vif [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:38:13,bridge_name='br-int',has_traffic_filtering=True,id=b72f8a84-e264-4da0-b7da-0ab8750b046a,network=Network(51197f16-755c-4fca-a0a8-75bf5b5444ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72f8a84-e2') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb72f8a84-e2, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:40:49 user nova-compute[73067]: INFO os_vif [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:38:13,bridge_name='br-int',has_traffic_filtering=True,id=b72f8a84-e264-4da0-b7da-0ab8750b046a,network=Network(51197f16-755c-4fca-a0a8-75bf5b5444ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72f8a84-e2')
Aug 16 10:40:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJWAqkLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '0368e3e4-ecb6-4f51-afa1-19159cdb99fd'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:40:49 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f36e8be-9601-41a8-ad62-959ff30b6d8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c83e6b1-f77e-40d1-8a1c-4df8f55a5140]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:40:49 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:40:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd (non-flash)
Aug 16 10:40:49 user nova-compute[73067]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:40:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f356411b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd'): ({'sdf'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Removing single pathed devices sdf {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16dfece-c251-4845-acf2-7776e91a338e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd681f24-3401-4ffe-b93e-69abd7118811]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Flushing IO for device /dev/sdf {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca69321b-1e1d-4979-b2f0-55acf42ea894]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad38180-7e2f-488f-9390-edbeaa3abf60]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] SCSI volumes sdf have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c706432c-b421-4891-95fe-56d4ccaabb06]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f8e668-4559-49e8-bf70-eb74b69f4c9c]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd, portal: 172.16.0.220,3260]
Aug 16 10:40:49 user nova-compute[73067]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd, portal: 172.16.0.220,3260] successful.
Aug 16 10:40:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0368e3e4-ecb6-4f51-afa1-19159cdb99fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea21e15-a701-4f84-96d7-2a17ebb69f43]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] <== disconnect_volume: return (290ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:40:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Deleting instance files /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737_del
Aug 16 10:40:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Deletion of /opt/stack/data/nova/instances/0f85b78e-78c3-4e5a-a33d-ace04474a737_del complete
Aug 16 10:40:49 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182434.8802114, 2448aa3f-a0a6-43c6-8844-dbfb8145d779 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:40:49 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] VM Stopped (Lifecycle Event)
Aug 16 10:40:49 user nova-compute[73067]: INFO nova.compute.manager [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 16 10:40:49 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:40:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a46b61cd-9164-4f72-9d3e-33406e1f56a2 None None] [instance: 2448aa3f-a0a6-43c6-8844-dbfb8145d779] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:40:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-bcfe413d-695b-46cb-8aa8-e9470d23fc7c req-b976c921-9115-44a1-bd8a-18c486ba1d3f service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received event network-vif-plugged-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bcfe413d-695b-46cb-8aa8-e9470d23fc7c req-b976c921-9115-44a1-bd8a-18c486ba1d3f service nova] Acquiring lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bcfe413d-695b-46cb-8aa8-e9470d23fc7c req-b976c921-9115-44a1-bd8a-18c486ba1d3f service nova] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bcfe413d-695b-46cb-8aa8-e9470d23fc7c req-b976c921-9115-44a1-bd8a-18c486ba1d3f service nova] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-bcfe413d-695b-46cb-8aa8-e9470d23fc7c req-b976c921-9115-44a1-bd8a-18c486ba1d3f service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] No waiting events found dispatching network-vif-plugged-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:40:51 user nova-compute[73067]: WARNING nova.compute.manager [req-bcfe413d-695b-46cb-8aa8-e9470d23fc7c req-b976c921-9115-44a1-bd8a-18c486ba1d3f service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received unexpected event network-vif-plugged-b72f8a84-e264-4da0-b7da-0ab8750b046a for instance with vm_state active and task_state deleting.
Aug 16 10:40:51 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:40:51 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Took 1.37 seconds to deallocate network for instance.
Aug 16 10:40:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-a6ecec5d-9171-488b-9563-4e2dea696653 req-b9e4562d-a3d8-4b8f-9224-bf5c80544b1f service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Received event network-vif-deleted-b72f8a84-e264-4da0-b7da-0ab8750b046a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:40:51 user nova-compute[73067]: INFO nova.compute.manager [req-a6ecec5d-9171-488b-9563-4e2dea696653 req-b9e4562d-a3d8-4b8f-9224-bf5c80544b1f service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Neutron deleted interface b72f8a84-e264-4da0-b7da-0ab8750b046a; detaching it from the instance and deleting it from the info cache
Aug 16 10:40:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-a6ecec5d-9171-488b-9563-4e2dea696653 req-b9e4562d-a3d8-4b8f-9224-bf5c80544b1f service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:40:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-a6ecec5d-9171-488b-9563-4e2dea696653 req-b9e4562d-a3d8-4b8f-9224-bf5c80544b1f service nova] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Detach interface failed, port_id=b72f8a84-e264-4da0-b7da-0ab8750b046a, reason: Instance 0f85b78e-78c3-4e5a-a33d-ace04474a737 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:40:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:52 user nova-compute[73067]: INFO nova.compute.manager [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Took 0.88 seconds to detach 1 volumes for instance.
Aug 16 10:40:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:40:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:40:52 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:40:52 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:40:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:52 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Deleted allocations for instance 0f85b78e-78c3-4e5a-a33d-ace04474a737
Aug 16 10:40:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0e18191-5864-4eee-82fb-a2301ea30568 tempest-TestVolumeSwap-690063517 tempest-TestVolumeSwap-690063517-project-member] Lock "0f85b78e-78c3-4e5a-a33d-ace04474a737" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.047s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:40:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:40:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:04 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182449.4500391, 0f85b78e-78c3-4e5a-a33d-ace04474a737 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:41:04 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] VM Stopped (Lifecycle Event)
Aug 16 10:41:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-266daa6e-09b2-4387-8110-6dd8da70c71c None None] [instance: 0f85b78e-78c3-4e5a-a33d-ace04474a737] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:41:26 user nova-compute[73067]: INFO nova.compute.claims [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Claim successful on node user
Aug 16 10:41:26 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:41:26 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:41:27 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:41:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:41:27 user nova-compute[73067]: INFO nova.virt.block_device [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Booting with volume 7132cfff-0821-4477-b0c2-07ee5c870273 at /dev/vda
Aug 16 10:41:27 user nova-compute[73067]: DEBUG nova.policy [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e4cbf9cec1c4c438adbbab6bd7f794c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7b37f1cdfe41ddb6545c23a5b5c8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG os_brick.utils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25ddc73-7c38-422e-ab74-43efba1f142c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabc3983-26c0-4a2f-a259-e7303831ccc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[67959690-e290-4060-a8f1-82e967a73a1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa919aac-52ad-442c-8bf7-7a96cea018c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:41:27 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa1dd8-6e0d-4114-aeaa-18a7d47174ce]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG os_brick.utils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating existing volume attachment record: 54b82795-ea61-4f7f-8375-d21abddb8525 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:27 user nova-compute[73067]: INFO nova.compute.manager [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Terminating instance
Aug 16 10:41:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-0082b175-dba7-4ac1-b237-fec84525280d req-c529c31d-0203-4c24-87bc-45020ddcc051 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received event network-changed-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-0082b175-dba7-4ac1-b237-fec84525280d req-c529c31d-0203-4c24-87bc-45020ddcc051 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Refreshing instance network info cache due to event network-changed-428c8372-75c3-4d2d-a626-41a1bc868f2f. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0082b175-dba7-4ac1-b237-fec84525280d req-c529c31d-0203-4c24-87bc-45020ddcc051 service nova] Acquiring lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0082b175-dba7-4ac1-b237-fec84525280d req-c529c31d-0203-4c24-87bc-45020ddcc051 service nova] Acquired lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG nova.network.neutron [req-0082b175-dba7-4ac1-b237-fec84525280d req-c529c31d-0203-4c24-87bc-45020ddcc051 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Refreshing network info cache for port 428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Instance destroyed successfully.
Aug 16 10:41:28 user nova-compute[73067]: DEBUG nova.objects.instance [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'resources' on Instance uuid 7f99c350-1c4e-47e8-884a-e821b6dd83bc {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG nova.compute.manager [req-f87b1f98-0772-4ee6-9b1a-fdf867e9b8e4 req-7c2347d3-f867-43ca-98a5-27295edad0b2 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received event network-vif-unplugged-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f87b1f98-0772-4ee6-9b1a-fdf867e9b8e4 req-7c2347d3-f867-43ca-98a5-27295edad0b2 service nova] Acquiring lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f87b1f98-0772-4ee6-9b1a-fdf867e9b8e4 req-7c2347d3-f867-43ca-98a5-27295edad0b2 service nova] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f87b1f98-0772-4ee6-9b1a-fdf867e9b8e4 req-7c2347d3-f867-43ca-98a5-27295edad0b2 service nova] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG nova.compute.manager [req-f87b1f98-0772-4ee6-9b1a-fdf867e9b8e4 req-7c2347d3-f867-43ca-98a5-27295edad0b2 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] No waiting events found dispatching network-vif-unplugged-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG nova.compute.manager [req-f87b1f98-0772-4ee6-9b1a-fdf867e9b8e4 req-7c2347d3-f867-43ca-98a5-27295edad0b2 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received event network-vif-unplugged-428c8372-75c3-4d2d-a626-41a1bc868f2f for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-24187425',display_name='tempest-TestStampPattern-server-24187425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-24187425',id=26,image_ref='02170190-cbbe-4fb6-af54-cc2952e586b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhzbKl1sw2z92eEIWjGNXUHNDN+YFEF4o3EjSp4os/3KmUko/NUObr7P/Lm/HSenjudyIwF5g3sozv6zWEvvQfItOK8+Iy7HLWvdjDnl1Gv1Fe+d7iktSOtMwmKR6EbRw==',key_name='tempest-TestStampPattern-1751724200',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:38:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0867b7c5756147859834ccb143e32e83',ramdisk_id='',reservation_id='r-2enf8qbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fcb6379a-4c57-462b-a4ea-9680340a5137',image_min_disk='1',image_min_ram='0',image_owner_id='0867b7c5756147859834ccb143e32e83',image_owner_project_name='tempest-TestStampPattern-920566978',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-920566978-project-member',image_user_id='5c07aeeaa3b248358386475d9cab6197',owner_project_name='tempest-TestStampPattern-920566978',owner_user_name='tempest-TestStampPattern-920566978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:38:39Z,user_data=None,user_id='5c07aeeaa3b248358386475d9cab6197',uuid=7f99c350-1c4e-47e8-884a-e821b6dd83bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converting VIF {"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b2:5c,bridge_name='br-int',has_traffic_filtering=True,id=428c8372-75c3-4d2d-a626-41a1bc868f2f,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428c8372-75') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG os_vif [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b2:5c,bridge_name='br-int',has_traffic_filtering=True,id=428c8372-75c3-4d2d-a626-41a1bc868f2f,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428c8372-75') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap428c8372-75, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:41:28 user nova-compute[73067]: INFO os_vif [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b2:5c,bridge_name='br-int',has_traffic_filtering=True,id=428c8372-75c3-4d2d-a626-41a1bc868f2f,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428c8372-75')
Aug 16 10:41:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Deleting instance files /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc_del
Aug 16 10:41:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Deletion of /opt/stack/data/nova/instances/7f99c350-1c4e-47e8-884a-e821b6dd83bc_del complete
Aug 16 10:41:28 user nova-compute[73067]: INFO nova.compute.manager [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 10:41:28 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:41:28 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:41:29 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Took 0.55 seconds to deallocate network for instance.
Aug 16 10:41:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-adaef87b-9a0f-4fa2-8990-f92edaecaa2b req-f2a8ceb8-62ce-4ebe-881a-9bb900dcd685 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received event network-vif-deleted-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG nova.network.neutron [req-0082b175-dba7-4ac1-b237-fec84525280d req-c529c31d-0203-4c24-87bc-45020ddcc051 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Updated VIF entry in instance network info cache for port 428c8372-75c3-4d2d-a626-41a1bc868f2f. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG nova.network.neutron [req-0082b175-dba7-4ac1-b237-fec84525280d req-c529c31d-0203-4c24-87bc-45020ddcc051 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Updating instance_info_cache with network_info: [{"id": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "address": "fa:16:3e:d5:b2:5c", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428c8372-75", "ovs_interfaceid": "428c8372-75c3-4d2d-a626-41a1bc868f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Successfully created port: e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0082b175-dba7-4ac1-b237-fec84525280d req-c529c31d-0203-4c24-87bc-45020ddcc051 service nova] Releasing lock "refresh_cache-7f99c350-1c4e-47e8-884a-e821b6dd83bc" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:29 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Deleted allocations for instance 7f99c350-1c4e-47e8-884a-e821b6dd83bc
Aug 16 10:41:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-61ffaeb1-eadf-43f5-b421-0b673bb28aa4 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.857s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:29 user nova-compute[73067]: INFO nova.compute.manager [None req-4666334b-342e-4dbe-8326-fb29cfc0e501 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Unrescuing
Aug 16 10:41:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4666334b-342e-4dbe-8326-fb29cfc0e501 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4666334b-342e-4dbe-8326-fb29cfc0e501 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquired lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:41:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-4666334b-342e-4dbe-8326-fb29cfc0e501 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:41:30 user nova-compute[73067]: INFO nova.compute.claims [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Claim successful on node user
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-ff1add07-b86c-4432-a96a-64714552d817 req-11c17df7-e0aa-4359-8ca8-682beb2835c2 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received event network-vif-plugged-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff1add07-b86c-4432-a96a-64714552d817 req-11c17df7-e0aa-4359-8ca8-682beb2835c2 service nova] Acquiring lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff1add07-b86c-4432-a96a-64714552d817 req-11c17df7-e0aa-4359-8ca8-682beb2835c2 service nova] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ff1add07-b86c-4432-a96a-64714552d817 req-11c17df7-e0aa-4359-8ca8-682beb2835c2 service nova] Lock "7f99c350-1c4e-47e8-884a-e821b6dd83bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-ff1add07-b86c-4432-a96a-64714552d817 req-11c17df7-e0aa-4359-8ca8-682beb2835c2 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] No waiting events found dispatching network-vif-plugged-428c8372-75c3-4d2d-a626-41a1bc868f2f {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:41:30 user nova-compute[73067]: WARNING nova.compute.manager [req-ff1add07-b86c-4432-a96a-64714552d817 req-11c17df7-e0aa-4359-8ca8-682beb2835c2 service nova] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Received unexpected event network-vif-plugged-428c8372-75c3-4d2d-a626-41a1bc868f2f for instance with vm_state deleted and task_state None.
Aug 16 10:41:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.network.neutron [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:41:30 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.policy [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be44e520761a493aab4b2a5973edd39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ce3a633ff54025aebcee0c30986ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:41:30 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Creating image(s)
Aug 16 10:41:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "/opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "/opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.212s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-4666334b-342e-4dbe-8326-fb29cfc0e501 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updating instance_info_cache with network_info: [{"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk 1073741824" returned: 0 in 0.102s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4666334b-342e-4dbe-8326-fb29cfc0e501 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Releasing lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-4666334b-342e-4dbe-8326-fb29cfc0e501 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'flavor' on Instance uuid 57c883ce-680f-455e-b393-e8c82576d440 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Successfully created port: 34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.221s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Successfully updated port: e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquired lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Cannot resize image /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'migration_context' on Instance uuid 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Ensure instance console log exists: /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:41:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:32 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Instance destroyed successfully.
Aug 16 10:41:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating instance_info_cache with network_info: [{"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Releasing lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Instance network_info: |[{"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-changed-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Refreshing instance network info cache due to event network-changed-e7f61fd6-dc62-4568-b823-1a23f93b3e40. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] Acquiring lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] Acquired lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Refreshing network info cache for port e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Successfully updated port: 34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "refresh_cache-5c7b9758-2f5f-4c06-b3af-5da0efcfb499" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquired lock "refresh_cache-5c7b9758-2f5f-4c06-b3af-5da0efcfb499" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-2a960c89-f19c-4850-880b-de3bb0b7fac6 req-670dbde3-9cd0-4522-b8ad-211f792c8d44 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received event network-changed-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-2a960c89-f19c-4850-880b-de3bb0b7fac6 req-670dbde3-9cd0-4522-b8ad-211f792c8d44 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Refreshing instance network info cache due to event network-changed-34d411e4-bda8-463e-9e31-a20a2510ab10. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2a960c89-f19c-4850-880b-de3bb0b7fac6 req-670dbde3-9cd0-4522-b8ad-211f792c8d44 service nova] Acquiring lock "refresh_cache-5c7b9758-2f5f-4c06-b3af-5da0efcfb499" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:41:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updated VIF entry in instance network info cache for port e7f61fd6-dc62-4568-b823-1a23f93b3e40. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating instance_info_cache with network_info: [{"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] Releasing lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-unplugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-unplugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:41:33 user nova-compute[73067]: WARNING nova.compute.manager [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-unplugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:41:33 user nova-compute[73067]: WARNING nova.compute.manager [req-4df12c14-8e13-4e0c-8ff3-f606ba9deda3 req-476b61c0-da74-44ff-b724-9d87b7e4d0b3 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Updating instance_info_cache with network_info: [{"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Releasing lock "refresh_cache-5c7b9758-2f5f-4c06-b3af-5da0efcfb499" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Instance network_info: |[{"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2a960c89-f19c-4850-880b-de3bb0b7fac6 req-670dbde3-9cd0-4522-b8ad-211f792c8d44 service nova] Acquired lock "refresh_cache-5c7b9758-2f5f-4c06-b3af-5da0efcfb499" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-2a960c89-f19c-4850-880b-de3bb0b7fac6 req-670dbde3-9cd0-4522-b8ad-211f792c8d44 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Refreshing network info cache for port 34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Start _get_guest_xml network_info=[{"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:41:33 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:41:33 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1638794165',display_name='tempest-AttachVolumeNegativeTest-server-1638794165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1638794165',id=30,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjZ3PlNay1d9CmXhLq0+mHau1xgy9SQr4ruCDQWlsS5X44PHKvuPXXLHtX+4tXWmDME8M4Hu3BJ0brFN7gY7OmINqbm8PDEpwZJPzqIPqiWEhDHDsp4Eqwh5408hZuW9Q==',key_name='tempest-keypair-627036877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-uwt0wxyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=5c7b9758-2f5f-4c06-b3af-5da0efcfb499,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8f:5b,bridge_name='br-int',has_traffic_filtering=True,id=34d411e4-bda8-463e-9e31-a20a2510ab10,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d411e4-bd') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:41:33 user nova-compute[73067]:   <uuid>5c7b9758-2f5f-4c06-b3af-5da0efcfb499</uuid>
Aug 16 10:41:33 user nova-compute[73067]:   <name>instance-0000001e</name>
Aug 16 10:41:33 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:41:33 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:41:33 user nova-compute[73067]:   <metadata>
Aug 16 10:41:33 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:41:33 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:41:33 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1638794165</nova:name>
Aug 16 10:41:33 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:41:33</nova:creationTime>
Aug 16 10:41:33 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:41:33 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:41:33 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:41:33 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:41:33 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:41:33 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:41:33 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:41:33 user nova-compute[73067]:       <nova:owner>
Aug 16 10:41:33 user nova-compute[73067]:         <nova:user uuid="be44e520761a493aab4b2a5973edd39c">tempest-AttachVolumeNegativeTest-630141842-project-member</nova:user>
Aug 16 10:41:33 user nova-compute[73067]:         <nova:project uuid="52ce3a633ff54025aebcee0c30986ad9">tempest-AttachVolumeNegativeTest-630141842</nova:project>
Aug 16 10:41:33 user nova-compute[73067]:       </nova:owner>
Aug 16 10:41:33 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:41:33 user nova-compute[73067]:       <nova:ports>
Aug 16 10:41:33 user nova-compute[73067]:         <nova:port uuid="34d411e4-bda8-463e-9e31-a20a2510ab10">
Aug 16 10:41:33 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 10:41:33 user nova-compute[73067]:         </nova:port>
Aug 16 10:41:33 user nova-compute[73067]:       </nova:ports>
Aug 16 10:41:33 user nova-compute[73067]:     </nova:instance>
Aug 16 10:41:33 user nova-compute[73067]:   </metadata>
Aug 16 10:41:33 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:41:33 user nova-compute[73067]:     <system>
Aug 16 10:41:33 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:41:33 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:41:33 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:41:33 user nova-compute[73067]:       <entry name="serial">5c7b9758-2f5f-4c06-b3af-5da0efcfb499</entry>
Aug 16 10:41:33 user nova-compute[73067]:       <entry name="uuid">5c7b9758-2f5f-4c06-b3af-5da0efcfb499</entry>
Aug 16 10:41:33 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:41:33 user nova-compute[73067]:     </system>
Aug 16 10:41:33 user nova-compute[73067]:   </sysinfo>
Aug 16 10:41:33 user nova-compute[73067]:   <os>
Aug 16 10:41:33 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:41:33 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:41:33 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:41:33 user nova-compute[73067]:   </os>
Aug 16 10:41:33 user nova-compute[73067]:   <features>
Aug 16 10:41:33 user nova-compute[73067]:     <acpi/>
Aug 16 10:41:33 user nova-compute[73067]:     <apic/>
Aug 16 10:41:33 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:41:33 user nova-compute[73067]:   </features>
Aug 16 10:41:33 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:41:33 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:41:33 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:41:33 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:41:33 user nova-compute[73067]:   </clock>
Aug 16 10:41:33 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:41:33 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:41:33 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:41:33 user nova-compute[73067]:   </cpu>
Aug 16 10:41:33 user nova-compute[73067]:   <devices>
Aug 16 10:41:33 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:41:33 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:41:33 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk"/>
Aug 16 10:41:33 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:41:33 user nova-compute[73067]:     </disk>
Aug 16 10:41:33 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:41:33 user nova-compute[73067]:       <mac address="fa:16:3e:f2:8f:5b"/>
Aug 16 10:41:33 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:41:33 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:41:33 user nova-compute[73067]:       <target dev="tap34d411e4-bd"/>
Aug 16 10:41:33 user nova-compute[73067]:     </interface>
Aug 16 10:41:33 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:41:33 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/console.log" append="off"/>
Aug 16 10:41:33 user nova-compute[73067]:     </serial>
Aug 16 10:41:33 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:41:33 user nova-compute[73067]:     <video>
Aug 16 10:41:33 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:41:33 user nova-compute[73067]:     </video>
Aug 16 10:41:33 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:41:33 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:41:33 user nova-compute[73067]:     </rng>
Aug 16 10:41:33 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:41:33 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:41:33 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:41:33 user nova-compute[73067]:     </memballoon>
Aug 16 10:41:33 user nova-compute[73067]:   </devices>
Aug 16 10:41:33 user nova-compute[73067]: </domain>
Aug 16 10:41:33 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1638794165',display_name='tempest-AttachVolumeNegativeTest-server-1638794165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1638794165',id=30,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjZ3PlNay1d9CmXhLq0+mHau1xgy9SQr4ruCDQWlsS5X44PHKvuPXXLHtX+4tXWmDME8M4Hu3BJ0brFN7gY7OmINqbm8PDEpwZJPzqIPqiWEhDHDsp4Eqwh5408hZuW9Q==',key_name='tempest-keypair-627036877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-uwt0wxyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=5c7b9758-2f5f-4c06-b3af-5da0efcfb499,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8f:5b,bridge_name='br-int',has_traffic_filtering=True,id=34d411e4-bda8-463e-9e31-a20a2510ab10,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d411e4-bd') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG os_vif [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8f:5b,bridge_name='br-int',has_traffic_filtering=True,id=34d411e4-bda8-463e-9e31-a20a2510ab10,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d411e4-bd') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34d411e4-bd, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34d411e4-bd, col_values=(('external_ids', {'iface-id': '34d411e4-bda8-463e-9e31-a20a2510ab10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:8f:5b', 'vm-uuid': '5c7b9758-2f5f-4c06-b3af-5da0efcfb499'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:33 user nova-compute[73067]: INFO os_vif [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8f:5b,bridge_name='br-int',has_traffic_filtering=True,id=34d411e4-bda8-463e-9e31-a20a2510ab10,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d411e4-bd')
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No VIF found with MAC fa:16:3e:f2:8f:5b, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-2a960c89-f19c-4850-880b-de3bb0b7fac6 req-670dbde3-9cd0-4522-b8ad-211f792c8d44 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Updated VIF entry in instance network info cache for port 34d411e4-bda8-463e-9e31-a20a2510ab10. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-2a960c89-f19c-4850-880b-de3bb0b7fac6 req-670dbde3-9cd0-4522-b8ad-211f792c8d44 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Updating instance_info_cache with network_info: [{"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:41:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2a960c89-f19c-4850-880b-de3bb0b7fac6 req-670dbde3-9cd0-4522-b8ad-211f792c8d44 service nova] Releasing lock "refresh_cache-5c7b9758-2f5f-4c06-b3af-5da0efcfb499" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:41:34 user nova-compute[73067]: WARNING nova.compute.manager [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:41:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:41:34 user nova-compute[73067]: WARNING nova.compute.manager [req-8d3be4e9-7d50-4ff4-a328-15946f9a1800 req-12c051f5-0268-4990-b40c-ffd16bccb1fb service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:41:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-5a654829-7e67-4078-a3ed-472178eaf50e req-61d4c830-2511-4389-8ccb-5c7f83f4f321 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received event network-vif-plugged-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5a654829-7e67-4078-a3ed-472178eaf50e req-61d4c830-2511-4389-8ccb-5c7f83f4f321 service nova] Acquiring lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5a654829-7e67-4078-a3ed-472178eaf50e req-61d4c830-2511-4389-8ccb-5c7f83f4f321 service nova] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5a654829-7e67-4078-a3ed-472178eaf50e req-61d4c830-2511-4389-8ccb-5c7f83f4f321 service nova] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-5a654829-7e67-4078-a3ed-472178eaf50e req-61d4c830-2511-4389-8ccb-5c7f83f4f321 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] No waiting events found dispatching network-vif-plugged-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:41:36 user nova-compute[73067]: WARNING nova.compute.manager [req-5a654829-7e67-4078-a3ed-472178eaf50e req-61d4c830-2511-4389-8ccb-5c7f83f4f321 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received unexpected event network-vif-plugged-34d411e4-bda8-463e-9e31-a20a2510ab10 for instance with vm_state building and task_state spawning.
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4666334b-342e-4dbe-8326-fb29cfc0e501 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for 57c883ce-680f-455e-b393-e8c82576d440 due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182497.3814154, 57c883ce-680f-455e-b393-e8c82576d440 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:41:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] VM Resumed (Lifecycle Event)
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:41:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182497.3818414, 57c883ce-680f-455e-b393-e8c82576d440 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:41:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] VM Started (Lifecycle Event)
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:41:37 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182497.9755158, 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:41:37 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] VM Resumed (Lifecycle Event)
Aug 16 10:41:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Instance spawned successfully.
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:41:38 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182497.9801967, 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:41:38 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] VM Started (Lifecycle Event)
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:41:38 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:41:38 user nova-compute[73067]: INFO nova.compute.manager [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Took 7.23 seconds to spawn the instance on the hypervisor.
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:38 user nova-compute[73067]: INFO nova.compute.manager [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Took 8.06 seconds to build instance.
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-63376eca-fd4a-43cf-b40f-4442a3632422 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.167s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-0d50f688-e819-43bb-a273-125365b73d00 req-a9aa30c9-5c8f-4f41-9181-d458c819dfba service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received event network-vif-plugged-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0d50f688-e819-43bb-a273-125365b73d00 req-a9aa30c9-5c8f-4f41-9181-d458c819dfba service nova] Acquiring lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0d50f688-e819-43bb-a273-125365b73d00 req-a9aa30c9-5c8f-4f41-9181-d458c819dfba service nova] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0d50f688-e819-43bb-a273-125365b73d00 req-a9aa30c9-5c8f-4f41-9181-d458c819dfba service nova] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-0d50f688-e819-43bb-a273-125365b73d00 req-a9aa30c9-5c8f-4f41-9181-d458c819dfba service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] No waiting events found dispatching network-vif-plugged-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:41:38 user nova-compute[73067]: WARNING nova.compute.manager [req-0d50f688-e819-43bb-a273-125365b73d00 req-a9aa30c9-5c8f-4f41-9181-d458c819dfba service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received unexpected event network-vif-plugged-34d411e4-bda8-463e-9e31-a20a2510ab10 for instance with vm_state active and task_state None.
Aug 16 10:41:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.519s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:41 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:41:41 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7952MB free_disk=25.18920135498047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fcb6379a-4c57-462b-a4ea-9680340a5137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 877d406e-ca6f-416f-a569-3cdc1ae545b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:41:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:41:42 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:41:42 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:41:42 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:41:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:41:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:41:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:41:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:41:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:41:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:41:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:41:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:43 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182488.5200841, 7f99c350-1c4e-47e8-884a-e821b6dd83bc => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:41:43 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] VM Stopped (Lifecycle Event)
Aug 16 10:41:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c1206cba-3bd9-4b5c-bd46-d6732aaf505c None None] [instance: 7f99c350-1c4e-47e8-884a-e821b6dd83bc] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updating instance_info_cache with network_info: [{"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:41:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:41:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:41:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:41:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:41:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:41:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:41:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:41:45 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Creating image(s)
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Ensure instance console log exists: /opt/stack/data/nova/instances/877d406e-ca6f-416f-a569-3cdc1ae545b2/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Start _get_guest_xml network_info=[{"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJWqLcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '877d406e-ca6f-416f-a569-3cdc1ae545b2', 'attached_at': '', 'detached_at': '', 'volume_id': '7132cfff-0821-4477-b0c2-07ee5c870273', 'serial': '7132cfff-0821-4477-b0c2-07ee5c870273'}, 'delete_on_termination': True, 'attachment_id': '54b82795-ea61-4f7f-8375-d21abddb8525', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:41:45 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:41:45 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJWqLcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:41:45 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:41:45 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:41:45 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2294c9-1e33-41cf-b38c-e75e3f3fb20f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:41:45 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6999859f-7590-4c98-8ddd-44ff2444aab0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273] added
Aug 16 10:41:45 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4690119-ec6b-4008-9dec-2d241a136408]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf873a7-2365-4971-8d6d-c2300c5d5664]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJWqLcps {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJWqLcps" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[307cee7c-8217-4691-b3cd-f2657c3eff87]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OJWqLcps'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[87233b37-e9ad-4709-bfa6-7a944f67c6be]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdb3c19-b936-4dbe-90a4-59baf9d7c0da]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:41:45 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:41:45 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ac28a2-fa1c-4fcd-9f21-eae304f6151f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260]
Aug 16 10:41:45 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260] successful.
Aug 16 10:41:45 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ad5468-c3a2-4897-9796-ec24744af2e6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb129ed-d03b-4a8f-8570-9bb5e9571de9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:41:45 user nova-compute[73067]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:41:45 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:41:45 user nova-compute[73067]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:41:45 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d9ead6-6278-41a6-9c1e-f2091f55c9c3]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:41:45 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJWqLcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26530613664643164', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530613664643164', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-488171748',display_name='tempest-ServerActionsTestOtherA-server-488171748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-488171748',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhgla1EGudnUgMo8sp69bGCzI9KExAhN9Vh+LGcPb7ZOjWlvBFg2zY0lGwEq2wsMYNd+BUSx+LuV7e4QllhSz+KH5UmhKYnFLZT6xPiJcUN2ahr8Bxzv1S1RvOd3h/nwA==',key_name='tempest-keypair-88160896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-yv50xdsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=877d406e-ca6f-416f-a569-3cdc1ae545b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'pci_devices' on Instance uuid 877d406e-ca6f-416f-a569-3cdc1ae545b2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:41:46 user nova-compute[73067]:   <uuid>877d406e-ca6f-416f-a569-3cdc1ae545b2</uuid>
Aug 16 10:41:46 user nova-compute[73067]:   <name>instance-0000001d</name>
Aug 16 10:41:46 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:41:46 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:41:46 user nova-compute[73067]:   <metadata>
Aug 16 10:41:46 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:41:46 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:41:46 user nova-compute[73067]:       <nova:name>tempest-ServerActionsTestOtherA-server-488171748</nova:name>
Aug 16 10:41:46 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:41:45</nova:creationTime>
Aug 16 10:41:46 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:41:46 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:41:46 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:41:46 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:41:46 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:41:46 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:41:46 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:41:46 user nova-compute[73067]:       <nova:owner>
Aug 16 10:41:46 user nova-compute[73067]:         <nova:user uuid="9e4cbf9cec1c4c438adbbab6bd7f794c">tempest-ServerActionsTestOtherA-1833692287-project-member</nova:user>
Aug 16 10:41:46 user nova-compute[73067]:         <nova:project uuid="1b7b37f1cdfe41ddb6545c23a5b5c8b4">tempest-ServerActionsTestOtherA-1833692287</nova:project>
Aug 16 10:41:46 user nova-compute[73067]:       </nova:owner>
Aug 16 10:41:46 user nova-compute[73067]:       <nova:ports>
Aug 16 10:41:46 user nova-compute[73067]:         <nova:port uuid="e7f61fd6-dc62-4568-b823-1a23f93b3e40">
Aug 16 10:41:46 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 10:41:46 user nova-compute[73067]:         </nova:port>
Aug 16 10:41:46 user nova-compute[73067]:       </nova:ports>
Aug 16 10:41:46 user nova-compute[73067]:     </nova:instance>
Aug 16 10:41:46 user nova-compute[73067]:   </metadata>
Aug 16 10:41:46 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:41:46 user nova-compute[73067]:     <system>
Aug 16 10:41:46 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:41:46 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:41:46 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:41:46 user nova-compute[73067]:       <entry name="serial">877d406e-ca6f-416f-a569-3cdc1ae545b2</entry>
Aug 16 10:41:46 user nova-compute[73067]:       <entry name="uuid">877d406e-ca6f-416f-a569-3cdc1ae545b2</entry>
Aug 16 10:41:46 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:41:46 user nova-compute[73067]:     </system>
Aug 16 10:41:46 user nova-compute[73067]:   </sysinfo>
Aug 16 10:41:46 user nova-compute[73067]:   <os>
Aug 16 10:41:46 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:41:46 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:41:46 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:41:46 user nova-compute[73067]:   </os>
Aug 16 10:41:46 user nova-compute[73067]:   <features>
Aug 16 10:41:46 user nova-compute[73067]:     <acpi/>
Aug 16 10:41:46 user nova-compute[73067]:     <apic/>
Aug 16 10:41:46 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:41:46 user nova-compute[73067]:   </features>
Aug 16 10:41:46 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:41:46 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:41:46 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:41:46 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:41:46 user nova-compute[73067]:   </clock>
Aug 16 10:41:46 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:41:46 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:41:46 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:41:46 user nova-compute[73067]:   </cpu>
Aug 16 10:41:46 user nova-compute[73067]:   <devices>
Aug 16 10:41:46 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:41:46 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:41:46 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 10:41:46 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:41:46 user nova-compute[73067]:       <serial>7132cfff-0821-4477-b0c2-07ee5c870273</serial>
Aug 16 10:41:46 user nova-compute[73067]:     </disk>
Aug 16 10:41:46 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:41:46 user nova-compute[73067]:       <mac address="fa:16:3e:4a:6a:a1"/>
Aug 16 10:41:46 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:41:46 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:41:46 user nova-compute[73067]:       <target dev="tape7f61fd6-dc"/>
Aug 16 10:41:46 user nova-compute[73067]:     </interface>
Aug 16 10:41:46 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:41:46 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/877d406e-ca6f-416f-a569-3cdc1ae545b2/console.log" append="off"/>
Aug 16 10:41:46 user nova-compute[73067]:     </serial>
Aug 16 10:41:46 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:41:46 user nova-compute[73067]:     <video>
Aug 16 10:41:46 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:41:46 user nova-compute[73067]:     </video>
Aug 16 10:41:46 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:41:46 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:41:46 user nova-compute[73067]:     </rng>
Aug 16 10:41:46 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:41:46 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:41:46 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:41:46 user nova-compute[73067]:     </memballoon>
Aug 16 10:41:46 user nova-compute[73067]:   </devices>
Aug 16 10:41:46 user nova-compute[73067]: </domain>
Aug 16 10:41:46 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-488171748',display_name='tempest-ServerActionsTestOtherA-server-488171748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-488171748',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhgla1EGudnUgMo8sp69bGCzI9KExAhN9Vh+LGcPb7ZOjWlvBFg2zY0lGwEq2wsMYNd+BUSx+LuV7e4QllhSz+KH5UmhKYnFLZT6xPiJcUN2ahr8Bxzv1S1RvOd3h/nwA==',key_name='tempest-keypair-88160896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-yv50xdsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=877d406e-ca6f-416f-a569-3cdc1ae545b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG os_vif [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7f61fd6-dc, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7f61fd6-dc, col_values=(('external_ids', {'iface-id': 'e7f61fd6-dc62-4568-b823-1a23f93b3e40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:6a:a1', 'vm-uuid': '877d406e-ca6f-416f-a569-3cdc1ae545b2'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:46 user nova-compute[73067]: INFO os_vif [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc')
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:41:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No VIF found with MAC fa:16:3e:4a:6a:a1, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:41:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-392d6ddb-5c6f-4a91-a9bd-559ceb09d3d9 req-086aeb9d-ad13-4776-b9a0-ec1829f2daaf service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-392d6ddb-5c6f-4a91-a9bd-559ceb09d3d9 req-086aeb9d-ad13-4776-b9a0-ec1829f2daaf service nova] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-392d6ddb-5c6f-4a91-a9bd-559ceb09d3d9 req-086aeb9d-ad13-4776-b9a0-ec1829f2daaf service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-392d6ddb-5c6f-4a91-a9bd-559ceb09d3d9 req-086aeb9d-ad13-4776-b9a0-ec1829f2daaf service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-392d6ddb-5c6f-4a91-a9bd-559ceb09d3d9 req-086aeb9d-ad13-4776-b9a0-ec1829f2daaf service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] No waiting events found dispatching network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:41:48 user nova-compute[73067]: WARNING nova.compute.manager [req-392d6ddb-5c6f-4a91-a9bd-559ceb09d3d9 req-086aeb9d-ad13-4776-b9a0-ec1829f2daaf service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received unexpected event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 for instance with vm_state building and task_state spawning.
Aug 16 10:41:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182510.72973, 877d406e-ca6f-416f-a569-3cdc1ae545b2 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:41:50 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] VM Resumed (Lifecycle Event)
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:41:50 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Instance spawned successfully.
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-07afc16a-8c25-44c1-bb63-0d3ecee646e8 req-2928bbdb-fbe3-4129-8f54-15e1125255ae service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-07afc16a-8c25-44c1-bb63-0d3ecee646e8 req-2928bbdb-fbe3-4129-8f54-15e1125255ae service nova] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-07afc16a-8c25-44c1-bb63-0d3ecee646e8 req-2928bbdb-fbe3-4129-8f54-15e1125255ae service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-07afc16a-8c25-44c1-bb63-0d3ecee646e8 req-2928bbdb-fbe3-4129-8f54-15e1125255ae service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-07afc16a-8c25-44c1-bb63-0d3ecee646e8 req-2928bbdb-fbe3-4129-8f54-15e1125255ae service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] No waiting events found dispatching network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:41:50 user nova-compute[73067]: WARNING nova.compute.manager [req-07afc16a-8c25-44c1-bb63-0d3ecee646e8 req-2928bbdb-fbe3-4129-8f54-15e1125255ae service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received unexpected event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 for instance with vm_state building and task_state spawning.
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:41:50 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182510.7383902, 877d406e-ca6f-416f-a569-3cdc1ae545b2 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:41:50 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] VM Started (Lifecycle Event)
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:41:50 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:41:50 user nova-compute[73067]: INFO nova.compute.manager [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 16 10:41:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:41:51 user nova-compute[73067]: INFO nova.compute.manager [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Took 24.86 seconds to build instance.
Aug 16 10:41:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fae85d8-01a1-4768-9987-8281adb6cb13 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.977s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:41:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:41:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:06 user nova-compute[73067]: INFO nova.compute.manager [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Unshelving
Aug 16 10:42:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:07 user nova-compute[73067]: INFO nova.virt.block_device [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Booting with volume 506bb603-39bf-468d-82d5-a075eea2e91f at /dev/vdc
Aug 16 10:42:07 user nova-compute[73067]: DEBUG os_brick.utils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e466f8-09f3-4646-b808-2ade21152c45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f6d230-bb77-4e5e-bfe0-9bde0c629784]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f83632c-9df9-438b-9748-253c14b6f8d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f2e9ff-6adb-4bb6-87be-18151dfd133b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:42:07 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:42:07 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4af1dd-ede3-4528-8c71-b25bc1b3efb2]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG os_brick.utils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:42:07 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updating existing volume attachment record: ac4b3ca2-b481-4d0f-a1b4-98748d971256 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:42:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:42:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:42:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:42:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:42:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:42:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:42:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'pci_requests' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:42:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:42:31 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:42:31 user nova-compute[73067]: INFO nova.compute.claims [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Claim successful on node user
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-ba8ed9ad-b59a-4390-b074-3e8e65704abb req-b3053fd5-f4a3-49e7-807d-ac8a9a6fb369 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received event network-changed-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-ba8ed9ad-b59a-4390-b074-3e8e65704abb req-b3053fd5-f4a3-49e7-807d-ac8a9a6fb369 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Refreshing instance network info cache due to event network-changed-00b9e9ea-45dd-4562-b426-4d1138de93b4. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ba8ed9ad-b59a-4390-b074-3e8e65704abb req-b3053fd5-f4a3-49e7-807d-ac8a9a6fb369 service nova] Acquiring lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ba8ed9ad-b59a-4390-b074-3e8e65704abb req-b3053fd5-f4a3-49e7-807d-ac8a9a6fb369 service nova] Acquired lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-ba8ed9ad-b59a-4390-b074-3e8e65704abb req-b3053fd5-f4a3-49e7-807d-ac8a9a6fb369 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Refreshing network info cache for port 00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:32 user nova-compute[73067]: INFO nova.compute.manager [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Terminating instance
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:32 user nova-compute[73067]: INFO nova.network.neutron [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updating port 9aec1f71-9229-4e37-b633-b2204d7a4484 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-ba8ed9ad-b59a-4390-b074-3e8e65704abb req-b3053fd5-f4a3-49e7-807d-ac8a9a6fb369 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updated VIF entry in instance network info cache for port 00b9e9ea-45dd-4562-b426-4d1138de93b4. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-ba8ed9ad-b59a-4390-b074-3e8e65704abb req-b3053fd5-f4a3-49e7-807d-ac8a9a6fb369 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updating instance_info_cache with network_info: [{"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ba8ed9ad-b59a-4390-b074-3e8e65704abb req-b3053fd5-f4a3-49e7-807d-ac8a9a6fb369 service nova] Releasing lock "refresh_cache-fcb6379a-4c57-462b-a4ea-9680340a5137" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-4d8f0bcd-8ad1-45b1-8646-375604180e62 req-fdfe6a8a-a75a-47bb-832e-1a9682a1b3f6 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received event network-vif-unplugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4d8f0bcd-8ad1-45b1-8646-375604180e62 req-fdfe6a8a-a75a-47bb-832e-1a9682a1b3f6 service nova] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4d8f0bcd-8ad1-45b1-8646-375604180e62 req-fdfe6a8a-a75a-47bb-832e-1a9682a1b3f6 service nova] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4d8f0bcd-8ad1-45b1-8646-375604180e62 req-fdfe6a8a-a75a-47bb-832e-1a9682a1b3f6 service nova] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-4d8f0bcd-8ad1-45b1-8646-375604180e62 req-fdfe6a8a-a75a-47bb-832e-1a9682a1b3f6 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] No waiting events found dispatching network-vif-unplugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:42:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-4d8f0bcd-8ad1-45b1-8646-375604180e62 req-fdfe6a8a-a75a-47bb-832e-1a9682a1b3f6 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received event network-vif-unplugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:42:33 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Instance destroyed successfully.
Aug 16 10:42:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lazy-loading 'resources' on Instance uuid fcb6379a-4c57-462b-a4ea-9680340a5137 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1701261229',display_name='tempest-TestStampPattern-server-1701261229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1701261229',id=20,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhzbKl1sw2z92eEIWjGNXUHNDN+YFEF4o3EjSp4os/3KmUko/NUObr7P/Lm/HSenjudyIwF5g3sozv6zWEvvQfItOK8+Iy7HLWvdjDnl1Gv1Fe+d7iktSOtMwmKR6EbRw==',key_name='tempest-TestStampPattern-1751724200',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0867b7c5756147859834ccb143e32e83',ramdisk_id='',reservation_id='r-0b2o14b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-920566978',owner_user_name='tempest-TestStampPattern-920566978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:38:25Z,user_data=None,user_id='5c07aeeaa3b248358386475d9cab6197',uuid=fcb6379a-4c57-462b-a4ea-9680340a5137,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converting VIF {"id": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "address": "fa:16:3e:1c:e6:b8", "network": {"id": "de3d4bc7-6723-4cac-8e2b-d345bf50411e", "bridge": "br-int", "label": "tempest-TestStampPattern-729064655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0867b7c5756147859834ccb143e32e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b9e9ea-45", "ovs_interfaceid": "00b9e9ea-45dd-4562-b426-4d1138de93b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:e6:b8,bridge_name='br-int',has_traffic_filtering=True,id=00b9e9ea-45dd-4562-b426-4d1138de93b4,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b9e9ea-45') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG os_vif [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:e6:b8,bridge_name='br-int',has_traffic_filtering=True,id=00b9e9ea-45dd-4562-b426-4d1138de93b4,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b9e9ea-45') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00b9e9ea-45, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:42:33 user nova-compute[73067]: INFO os_vif [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:e6:b8,bridge_name='br-int',has_traffic_filtering=True,id=00b9e9ea-45dd-4562-b426-4d1138de93b4,network=Network(de3d4bc7-6723-4cac-8e2b-d345bf50411e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b9e9ea-45')
Aug 16 10:42:33 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Deleting instance files /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137_del
Aug 16 10:42:33 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Deletion of /opt/stack/data/nova/instances/fcb6379a-4c57-462b-a4ea-9680340a5137_del complete
Aug 16 10:42:33 user nova-compute[73067]: INFO nova.compute.manager [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 10:42:33 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-99d3c04c-e242-47ac-9f54-58b5729e84dc req-3f694e5b-b142-4aa9-9b96-8837c6bf0cec service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received event network-vif-deleted-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:42:33 user nova-compute[73067]: INFO nova.compute.manager [req-99d3c04c-e242-47ac-9f54-58b5729e84dc req-3f694e5b-b142-4aa9-9b96-8837c6bf0cec service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Neutron deleted interface 00b9e9ea-45dd-4562-b426-4d1138de93b4; detaching it from the instance and deleting it from the info cache
Aug 16 10:42:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-99d3c04c-e242-47ac-9f54-58b5729e84dc req-3f694e5b-b142-4aa9-9b96-8837c6bf0cec service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:42:33 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-99d3c04c-e242-47ac-9f54-58b5729e84dc req-3f694e5b-b142-4aa9-9b96-8837c6bf0cec service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Detach interface failed, port_id=00b9e9ea-45dd-4562-b426-4d1138de93b4, reason: Instance fcb6379a-4c57-462b-a4ea-9680340a5137 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:42:34 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Took 0.75 seconds to deallocate network for instance.
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquired lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG nova.network.neutron [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:34 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Deleted allocations for instance fcb6379a-4c57-462b-a4ea-9680340a5137
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a3c4ebb0-ba55-477a-a5fc-5b9271dce433 tempest-TestStampPattern-920566978 tempest-TestStampPattern-920566978-project-member] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.210s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG nova.network.neutron [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updating instance_info_cache with network_info: [{"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Releasing lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:42:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Creating image(s)
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "/opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "/opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "375f32c80fefecd3d990db70630d005836f4fa35" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "375f32c80fefecd3d990db70630d005836f4fa35" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35.part --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received event network-vif-plugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:42:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] Acquiring lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] Lock "fcb6379a-4c57-462b-a4ea-9680340a5137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] No waiting events found dispatching network-vif-plugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:42:36 user nova-compute[73067]: WARNING nova.compute.manager [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Received unexpected event network-vif-plugged-00b9e9ea-45dd-4562-b426-4d1138de93b4 for instance with vm_state deleted and task_state None.
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-changed-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Refreshing instance network info cache due to event network-changed-9aec1f71-9229-4e37-b633-b2204d7a4484. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] Acquiring lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] Acquired lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.network.neutron [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Refreshing network info cache for port 9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35.part --force-share --output=json" returned: 0 in 0.209s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.virt.images [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] a75331ca-7540-4048-a292-237a7f49cf79 was qcow2, converting to raw {{(pid=73067) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35.part /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35.converted {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35.part /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35.converted" returned: 0 in 0.496s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35.converted --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.network.neutron [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updated VIF entry in instance network info cache for port 9aec1f71-9229-4e37-b633-b2204d7a4484. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.network.neutron [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updating instance_info_cache with network_info: [{"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e82d7fe8-9c38-4f5c-9a3c-2cb933fbd9ed req-9e31f88f-026b-4cce-9047-73ace842c5f3 service nova] Releasing lock "refresh_cache-4b3c2355-eee1-4a0f-bebc-9425ec85aac4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "375f32c80fefecd3d990db70630d005836f4fa35" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.194s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:42:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35 --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "375f32c80fefecd3d990db70630d005836f4fa35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "375f32c80fefecd3d990db70630d005836f4fa35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35 --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35,backing_fmt=raw /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35,backing_fmt=raw /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk 1073741824" returned: 0 in 0.058s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "375f32c80fefecd3d990db70630d005836f4fa35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35 --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'migration_context' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:42:37 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Rebasing disk image.
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.199s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 -F raw /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:42:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7833MB free_disk=25.185134887695312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 877d406e-ca6f-416f-a569-3cdc1ae545b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:42:39 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 -F raw /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk" returned: 0 in 2.356s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Ensure instance console log exists: /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Start _get_guest_xml network_info=[{"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='bec7364ddd46e56e6bd83a68ca3c5588',container_format='bare',created_at=2023-08-16T10:40:13Z,direct_url=<?>,disk_format='qcow2',id=a75331ca-7540-4048-a292-237a7f49cf79,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1846221895-shelved',owner='1390d54176cf46679a1d44d85aa20ba0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T10:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wczJUZyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4b3c2355-eee1-4a0f-bebc-9425ec85aac4', 'attached_at': '', 'detached_at': '', 'volume_id': '506bb603-39bf-468d-82d5-a075eea2e91f', 'serial': '506bb603-39bf-468d-82d5-a075eea2e91f'}, 'delete_on_termination': False, 'attachment_id': 'ac4b3ca2-b481-4d0f-a1b4-98748d971256', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:42:40 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:42:40 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bec7364ddd46e56e6bd83a68ca3c5588',container_format='bare',created_at=2023-08-16T10:40:13Z,direct_url=<?>,disk_format='qcow2',id=a75331ca-7540-4048-a292-237a7f49cf79,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1846221895-shelved',owner='1390d54176cf46679a1d44d85aa20ba0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T10:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wczJUZyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:42:40 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:42:40 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:42:40 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed95ea0e-4e35-48bc-869e-6551180e26db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:42:40 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2705b18-4ee5-488e-8298-333eac72280a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f] added
Aug 16 10:42:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a44b4e-0b6f-4c95-b864-8052f0ec993d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[adde1b81-a0dc-4890-a318-fea75d4cb8ef]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wczJUZyl {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wczJUZyl" returned: 0 in 0.034s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfba65b-53fb-44ab-85eb-516126f4baf6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wczJUZyl'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.067s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d9df42-1dec-45d0-b257-03d270c1c52b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dd3904-d629-47c7-8776-65521d5bc5ad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:42:40 user nova-compute[73067]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:42:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:42:40 user nova-compute[73067]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:42:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[41faf9d5-103b-4e7e-b0b7-7cc7b93a5f3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f, portal: 172.16.0.220,3260]
Aug 16 10:42:40 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f, portal: 172.16.0.220,3260] successful.
Aug 16 10:42:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[effe7e67-b1c0-4e8a-af7d-2bcafc872370]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1616d5b0-2418-4a7e-a2f8-4335a0e2d14b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:42:40 user nova-compute[73067]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:42:40 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:42:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:42:40 user nova-compute[73067]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:42:40 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:42:40 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7853d16d-3b95-488c-966c-382980db0c53]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:42:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wczJUZyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23933636139656265', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933636139656265', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1846221895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1846221895',id=25,image_ref='a75331ca-7540-4048-a292-237a7f49cf79',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-917872012',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:38:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-hbj32uf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member',shelved_at='2023-08-16T10:40:17.429626',shelved_host='user',shelved_image_id='a75331ca-7540-4048-a292-237a7f49cf79'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:42:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=4b3c2355-eee1-4a0f-bebc-9425ec85aac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:42:41 user nova-compute[73067]:   <uuid>4b3c2355-eee1-4a0f-bebc-9425ec85aac4</uuid>
Aug 16 10:42:41 user nova-compute[73067]:   <name>instance-00000019</name>
Aug 16 10:42:41 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:42:41 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:42:41 user nova-compute[73067]:   <metadata>
Aug 16 10:42:41 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:42:41 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:42:41 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1846221895</nova:name>
Aug 16 10:42:41 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:42:40</nova:creationTime>
Aug 16 10:42:41 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:42:41 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:42:41 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:42:41 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:42:41 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:42:41 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:42:41 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:42:41 user nova-compute[73067]:       <nova:owner>
Aug 16 10:42:41 user nova-compute[73067]:         <nova:user uuid="220084fddd114ff989a0603bdb98df76">tempest-AttachVolumeShelveTestJSON-295458602-project-member</nova:user>
Aug 16 10:42:41 user nova-compute[73067]:         <nova:project uuid="1390d54176cf46679a1d44d85aa20ba0">tempest-AttachVolumeShelveTestJSON-295458602</nova:project>
Aug 16 10:42:41 user nova-compute[73067]:       </nova:owner>
Aug 16 10:42:41 user nova-compute[73067]:       <nova:root type="image" uuid="a75331ca-7540-4048-a292-237a7f49cf79"/>
Aug 16 10:42:41 user nova-compute[73067]:       <nova:ports>
Aug 16 10:42:41 user nova-compute[73067]:         <nova:port uuid="9aec1f71-9229-4e37-b633-b2204d7a4484">
Aug 16 10:42:41 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 10:42:41 user nova-compute[73067]:         </nova:port>
Aug 16 10:42:41 user nova-compute[73067]:       </nova:ports>
Aug 16 10:42:41 user nova-compute[73067]:     </nova:instance>
Aug 16 10:42:41 user nova-compute[73067]:   </metadata>
Aug 16 10:42:41 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:42:41 user nova-compute[73067]:     <system>
Aug 16 10:42:41 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:42:41 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:42:41 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:42:41 user nova-compute[73067]:       <entry name="serial">4b3c2355-eee1-4a0f-bebc-9425ec85aac4</entry>
Aug 16 10:42:41 user nova-compute[73067]:       <entry name="uuid">4b3c2355-eee1-4a0f-bebc-9425ec85aac4</entry>
Aug 16 10:42:41 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:42:41 user nova-compute[73067]:     </system>
Aug 16 10:42:41 user nova-compute[73067]:   </sysinfo>
Aug 16 10:42:41 user nova-compute[73067]:   <os>
Aug 16 10:42:41 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:42:41 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:42:41 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:42:41 user nova-compute[73067]:   </os>
Aug 16 10:42:41 user nova-compute[73067]:   <features>
Aug 16 10:42:41 user nova-compute[73067]:     <acpi/>
Aug 16 10:42:41 user nova-compute[73067]:     <apic/>
Aug 16 10:42:41 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:42:41 user nova-compute[73067]:   </features>
Aug 16 10:42:41 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:42:41 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:42:41 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:42:41 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:42:41 user nova-compute[73067]:   </clock>
Aug 16 10:42:41 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:42:41 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:42:41 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:42:41 user nova-compute[73067]:   </cpu>
Aug 16 10:42:41 user nova-compute[73067]:   <devices>
Aug 16 10:42:41 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:42:41 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:42:41 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk"/>
Aug 16 10:42:41 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:42:41 user nova-compute[73067]:     </disk>
Aug 16 10:42:41 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:42:41 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:42:41 user nova-compute[73067]:       <source dev="/dev/sdc"/>
Aug 16 10:42:41 user nova-compute[73067]:       <target dev="vdc" bus="virtio"/>
Aug 16 10:42:41 user nova-compute[73067]:       <serial>506bb603-39bf-468d-82d5-a075eea2e91f</serial>
Aug 16 10:42:41 user nova-compute[73067]:     </disk>
Aug 16 10:42:41 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:42:41 user nova-compute[73067]:       <mac address="fa:16:3e:41:d5:23"/>
Aug 16 10:42:41 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:42:41 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:42:41 user nova-compute[73067]:       <target dev="tap9aec1f71-92"/>
Aug 16 10:42:41 user nova-compute[73067]:     </interface>
Aug 16 10:42:41 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:42:41 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/console.log" append="off"/>
Aug 16 10:42:41 user nova-compute[73067]:     </serial>
Aug 16 10:42:41 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:42:41 user nova-compute[73067]:     <video>
Aug 16 10:42:41 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:42:41 user nova-compute[73067]:     </video>
Aug 16 10:42:41 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:42:41 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:42:41 user nova-compute[73067]:     </rng>
Aug 16 10:42:41 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:42:41 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:42:41 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:42:41 user nova-compute[73067]:     </memballoon>
Aug 16 10:42:41 user nova-compute[73067]:   </devices>
Aug 16 10:42:41 user nova-compute[73067]: </domain>
Aug 16 10:42:41 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1846221895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1846221895',id=25,image_ref='a75331ca-7540-4048-a292-237a7f49cf79',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-917872012',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:38:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-hbj32uf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member',shelved_at='2023-08-16T10:40:17.429626',shelved_host='user',shelved_image_id='a75331ca-7540-4048-a292-237a7f49cf79'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:42:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=4b3c2355-eee1-4a0f-bebc-9425ec85aac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG os_vif [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9aec1f71-92, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9aec1f71-92, col_values=(('external_ids', {'iface-id': '9aec1f71-9229-4e37-b633-b2204d7a4484', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:d5:23', 'vm-uuid': '4b3c2355-eee1-4a0f-bebc-9425ec85aac4'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:41 user nova-compute[73067]: INFO os_vif [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92')
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:42:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] No VIF found with MAC fa:16:3e:41:d5:23, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:42:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:42:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:42:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-af36f5fc-6b2d-425e-a063-4ea330330a6d req-072d407c-6f0d-4693-95bb-fa46dc0d9ba0 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-af36f5fc-6b2d-425e-a063-4ea330330a6d req-072d407c-6f0d-4693-95bb-fa46dc0d9ba0 service nova] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-af36f5fc-6b2d-425e-a063-4ea330330a6d req-072d407c-6f0d-4693-95bb-fa46dc0d9ba0 service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-af36f5fc-6b2d-425e-a063-4ea330330a6d req-072d407c-6f0d-4693-95bb-fa46dc0d9ba0 service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-af36f5fc-6b2d-425e-a063-4ea330330a6d req-072d407c-6f0d-4693-95bb-fa46dc0d9ba0 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] No waiting events found dispatching network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:42:43 user nova-compute[73067]: WARNING nova.compute.manager [req-af36f5fc-6b2d-425e-a063-4ea330330a6d req-072d407c-6f0d-4693-95bb-fa46dc0d9ba0 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received unexpected event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 10:42:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182565.2948127, 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:42:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] VM Resumed (Lifecycle Event)
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:42:45 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance spawned successfully.
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:42:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182565.296198, 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:42:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] VM Started (Lifecycle Event)
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-a20f8acd-60b1-4ace-812c-cd753224bd00 req-5c908e09-64b8-4e3c-86ce-aa4bbd4faba9 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:42:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a20f8acd-60b1-4ace-812c-cd753224bd00 req-5c908e09-64b8-4e3c-86ce-aa4bbd4faba9 service nova] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:42:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a20f8acd-60b1-4ace-812c-cd753224bd00 req-5c908e09-64b8-4e3c-86ce-aa4bbd4faba9 service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:42:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a20f8acd-60b1-4ace-812c-cd753224bd00 req-5c908e09-64b8-4e3c-86ce-aa4bbd4faba9 service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-a20f8acd-60b1-4ace-812c-cd753224bd00 req-5c908e09-64b8-4e3c-86ce-aa4bbd4faba9 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] No waiting events found dispatching network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:42:45 user nova-compute[73067]: WARNING nova.compute.manager [req-a20f8acd-60b1-4ace-812c-cd753224bd00 req-5c908e09-64b8-4e3c-86ce-aa4bbd4faba9 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received unexpected event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 10:42:45 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:42:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:42:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2ab1d366-f2dc-4e7a-a8c8-1e00cf2d5271 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 38.768s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:42:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:48 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182553.1471918, fcb6379a-4c57-462b-a4ea-9680340a5137 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:42:48 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] VM Stopped (Lifecycle Event)
Aug 16 10:42:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e11b6ef1-6c0e-432d-97a1-a07a38434afa None None] [instance: fcb6379a-4c57-462b-a4ea-9680340a5137] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:42:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:42:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:42:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:42:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:42:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:42:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:42:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:42:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:42:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:42:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-9193b9eb-a4b7-4795-87f2-4f998374279c req-968abd83-64ff-41b3-ad07-16e75ec5eb21 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received event network-changed-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-9193b9eb-a4b7-4795-87f2-4f998374279c req-968abd83-64ff-41b3-ad07-16e75ec5eb21 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Refreshing instance network info cache due to event network-changed-3d884641-f0de-4b61-a8e7-c7791ec28e2d. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:43:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9193b9eb-a4b7-4795-87f2-4f998374279c req-968abd83-64ff-41b3-ad07-16e75ec5eb21 service nova] Acquiring lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:43:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9193b9eb-a4b7-4795-87f2-4f998374279c req-968abd83-64ff-41b3-ad07-16e75ec5eb21 service nova] Acquired lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:43:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-9193b9eb-a4b7-4795-87f2-4f998374279c req-968abd83-64ff-41b3-ad07-16e75ec5eb21 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Refreshing network info cache for port 3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:43:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-9193b9eb-a4b7-4795-87f2-4f998374279c req-968abd83-64ff-41b3-ad07-16e75ec5eb21 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updated VIF entry in instance network info cache for port 3d884641-f0de-4b61-a8e7-c7791ec28e2d. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:43:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-9193b9eb-a4b7-4795-87f2-4f998374279c req-968abd83-64ff-41b3-ad07-16e75ec5eb21 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updating instance_info_cache with network_info: [{"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:43:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9193b9eb-a4b7-4795-87f2-4f998374279c req-968abd83-64ff-41b3-ad07-16e75ec5eb21 service nova] Releasing lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:43:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Stashing vm_state: active {{(pid=73067) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-087eaa13-10e5-42d6-b08b-0ea0b75dba2d req-5664f873-3162-4ac1-9204-037cd89b91c8 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-changed-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-087eaa13-10e5-42d6-b08b-0ea0b75dba2d req-5664f873-3162-4ac1-9204-037cd89b91c8 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Refreshing instance network info cache due to event network-changed-e7f61fd6-dc62-4568-b823-1a23f93b3e40. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-087eaa13-10e5-42d6-b08b-0ea0b75dba2d req-5664f873-3162-4ac1-9204-037cd89b91c8 service nova] Acquiring lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-087eaa13-10e5-42d6-b08b-0ea0b75dba2d req-5664f873-3162-4ac1-9204-037cd89b91c8 service nova] Acquired lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-087eaa13-10e5-42d6-b08b-0ea0b75dba2d req-5664f873-3162-4ac1-9204-037cd89b91c8 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Refreshing network info cache for port e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.objects.instance [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'pci_requests' on Instance uuid 877d406e-ca6f-416f-a569-3cdc1ae545b2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:43:20 user nova-compute[73067]: INFO nova.compute.claims [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Claim successful on node user
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.objects.instance [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'resources' on Instance uuid 877d406e-ca6f-416f-a569-3cdc1ae545b2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.objects.instance [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'pci_devices' on Instance uuid 877d406e-ca6f-416f-a569-3cdc1ae545b2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:20 user nova-compute[73067]: INFO nova.compute.resource_tracker [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating resource usage from migration 8482254a-f9aa-4602-988d-1587375801c1
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.525s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:20 user nova-compute[73067]: INFO nova.compute.manager [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Migrating
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:43:20 user nova-compute[73067]: INFO nova.compute.rpcapi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-087eaa13-10e5-42d6-b08b-0ea0b75dba2d req-5664f873-3162-4ac1-9204-037cd89b91c8 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updated VIF entry in instance network info cache for port e7f61fd6-dc62-4568-b823-1a23f93b3e40. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-087eaa13-10e5-42d6-b08b-0ea0b75dba2d req-5664f873-3162-4ac1-9204-037cd89b91c8 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating instance_info_cache with network_info: [{"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-087eaa13-10e5-42d6-b08b-0ea0b75dba2d req-5664f873-3162-4ac1-9204-037cd89b91c8 service nova] Releasing lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquired lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:43:20 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:43:21 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating instance_info_cache with network_info: [{"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:43:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Releasing lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:43:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Starting migrate_disk_and_power_off {{(pid=73067) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 10:43:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-f862486c-1f5c-4411-8678-04e40ccb14a2 req-7f8f93a3-aabb-4f26-83d5-536f649054e3 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-vif-unplugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f862486c-1f5c-4411-8678-04e40ccb14a2 req-7f8f93a3-aabb-4f26-83d5-536f649054e3 service nova] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f862486c-1f5c-4411-8678-04e40ccb14a2 req-7f8f93a3-aabb-4f26-83d5-536f649054e3 service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f862486c-1f5c-4411-8678-04e40ccb14a2 req-7f8f93a3-aabb-4f26-83d5-536f649054e3 service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-f862486c-1f5c-4411-8678-04e40ccb14a2 req-7f8f93a3-aabb-4f26-83d5-536f649054e3 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] No waiting events found dispatching network-vif-unplugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:43:22 user nova-compute[73067]: WARNING nova.compute.manager [req-f862486c-1f5c-4411-8678-04e40ccb14a2 req-7f8f93a3-aabb-4f26-83d5-536f649054e3 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received unexpected event network-vif-unplugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 for instance with vm_state active and task_state resize_migrating.
Aug 16 10:43:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Instance destroyed successfully.
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-488171748',display_name='tempest-ServerActionsTestOtherA-server-488171748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-488171748',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhgla1EGudnUgMo8sp69bGCzI9KExAhN9Vh+LGcPb7ZOjWlvBFg2zY0lGwEq2wsMYNd+BUSx+LuV7e4QllhSz+KH5UmhKYnFLZT6xPiJcUN2ahr8Bxzv1S1RvOd3h/nwA==',key_name='tempest-keypair-88160896',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-yv50xdsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:43:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=877d406e-ca6f-416f-a569-3cdc1ae545b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-681058576-network", "vif_mac": "fa:16:3e:4a:6a:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-681058576-network", "vif_mac": "fa:16:3e:4a:6a:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_vif [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7f61fd6-dc, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:43:22 user nova-compute[73067]: INFO os_vif [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc')
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJWqLcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:43:22 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d955fe2-0684-4da3-9a4d-8a66e6b5cc29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5357b7-a7eb-4ae2-91b6-69fbe0e50e0a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:22 user nova-compute[73067]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:43:22 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:22 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:22 user nova-compute[73067]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:43:22 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:22 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35447efd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e550a4ef-3055-4afd-8f0d-3c3101f75655]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-049e1f99-7aba-487c-ae91-293d27854878 req-a94f4bae-e463-42ca-bd8a-34d569a2589a service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received event network-changed-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-049e1f99-7aba-487c-ae91-293d27854878 req-a94f4bae-e463-42ca-bd8a-34d569a2589a service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Refreshing instance network info cache due to event network-changed-34d411e4-bda8-463e-9e31-a20a2510ab10. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-049e1f99-7aba-487c-ae91-293d27854878 req-a94f4bae-e463-42ca-bd8a-34d569a2589a service nova] Acquiring lock "refresh_cache-5c7b9758-2f5f-4c06-b3af-5da0efcfb499" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-049e1f99-7aba-487c-ae91-293d27854878 req-a94f4bae-e463-42ca-bd8a-34d569a2589a service nova] Acquired lock "refresh_cache-5c7b9758-2f5f-4c06-b3af-5da0efcfb499" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-049e1f99-7aba-487c-ae91-293d27854878 req-a94f4bae-e463-42ca-bd8a-34d569a2589a service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Refreshing network info cache for port 34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "4bf85594-1255-4383-b359-17ee78c71c6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "4bf85594-1255-4383-b359-17ee78c71c6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[365be258-fdfa-4854-951d-61124b9ca9f4]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fcf552-1830-436e-906b-5f7e09e6b4ab]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[17465098-805d-4dc7-9f2f-dd9a20648de3]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_aec9d47b',) {{(pid=84181) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[96059a15-2d26-46bf-9efa-4379e1f8ba09]: (4, None) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[09de24d9-4c4c-49e0-b0a9-d3ce1864a52c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:43:22 user nova-compute[73067]: INFO nova.compute.claims [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Claim successful on node user
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd958568-821b-4831-9099-962f59c8be19]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260]
Aug 16 10:43:22 user nova-compute[73067]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260] successful.
Aug 16 10:43:22 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4660f73b-73ea-41e2-b263-ccfea95fb461]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== disconnect_volume: return (375ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:43:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.network.neutron [req-049e1f99-7aba-487c-ae91-293d27854878 req-a94f4bae-e463-42ca-bd8a-34d569a2589a service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Updated VIF entry in instance network info cache for port 34d411e4-bda8-463e-9e31-a20a2510ab10. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.network.neutron [req-049e1f99-7aba-487c-ae91-293d27854878 req-a94f4bae-e463-42ca-bd8a-34d569a2589a service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Updating instance_info_cache with network_info: [{"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-049e1f99-7aba-487c-ae91-293d27854878 req-a94f4bae-e463-42ca-bd8a-34d569a2589a service nova] Releasing lock "refresh_cache-5c7b9758-2f5f-4c06-b3af-5da0efcfb499" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:43:23 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.policy [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b135edcf064595b8d93052903696a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03e64450654fd693d6a1bd43017880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:43:23 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Creating image(s)
Aug 16 10:43:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "/opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "/opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.228s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk 1073741824" returned: 0 in 0.068s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Successfully created port: 01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG nova.compute.manager [req-168fc334-3e5c-4a88-862e-026effdf3ac7 req-92f64bf3-c808-4723-af8a-834fad3787bc service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-168fc334-3e5c-4a88-862e-026effdf3ac7 req-92f64bf3-c808-4723-af8a-834fad3787bc service nova] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-168fc334-3e5c-4a88-862e-026effdf3ac7 req-92f64bf3-c808-4723-af8a-834fad3787bc service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-168fc334-3e5c-4a88-862e-026effdf3ac7 req-92f64bf3-c808-4723-af8a-834fad3787bc service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG nova.compute.manager [req-168fc334-3e5c-4a88-862e-026effdf3ac7 req-92f64bf3-c808-4723-af8a-834fad3787bc service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] No waiting events found dispatching network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:43:24 user nova-compute[73067]: WARNING nova.compute.manager [req-168fc334-3e5c-4a88-862e-026effdf3ac7 req-92f64bf3-c808-4723-af8a-834fad3787bc service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received unexpected event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 for instance with vm_state active and task_state resize_migrating.
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Cannot resize image /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG nova.objects.instance [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'migration_context' on Instance uuid 4bf85594-1255-4383-b359-17ee78c71c6b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Ensure instance console log exists: /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:25 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Successfully updated port: 01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:43:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "refresh_cache-4bf85594-1255-4383-b359-17ee78c71c6b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:43:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquired lock "refresh_cache-4bf85594-1255-4383-b359-17ee78c71c6b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:43:25 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:43:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-dc510565-c7b2-4e19-83e1-aa84aa2e25d1 req-7e3371d9-95b1-40b6-8fc5-20f9a376e158 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Received event network-changed-01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-dc510565-c7b2-4e19-83e1-aa84aa2e25d1 req-7e3371d9-95b1-40b6-8fc5-20f9a376e158 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Refreshing instance network info cache due to event network-changed-01254719-e087-47bd-a902-e887841b2a50. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:43:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dc510565-c7b2-4e19-83e1-aa84aa2e25d1 req-7e3371d9-95b1-40b6-8fc5-20f9a376e158 service nova] Acquiring lock "refresh_cache-4bf85594-1255-4383-b359-17ee78c71c6b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:43:25 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Updating instance_info_cache with network_info: [{"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Releasing lock "refresh_cache-4bf85594-1255-4383-b359-17ee78c71c6b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Instance network_info: |[{"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dc510565-c7b2-4e19-83e1-aa84aa2e25d1 req-7e3371d9-95b1-40b6-8fc5-20f9a376e158 service nova] Acquired lock "refresh_cache-4bf85594-1255-4383-b359-17ee78c71c6b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.network.neutron [req-dc510565-c7b2-4e19-83e1-aa84aa2e25d1 req-7e3371d9-95b1-40b6-8fc5-20f9a376e158 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Refreshing network info cache for port 01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Start _get_guest_xml network_info=[{"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:43:26 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:43:26 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-733484165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-733484165',id=31,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-m7tr93lu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:43:24Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=4bf85594-1255-4383-b359-17ee78c71c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=01254719-e087-47bd-a902-e887841b2a50,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01254719-e0') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.objects.instance [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bf85594-1255-4383-b359-17ee78c71c6b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:43:26 user nova-compute[73067]:   <uuid>4bf85594-1255-4383-b359-17ee78c71c6b</uuid>
Aug 16 10:43:26 user nova-compute[73067]:   <name>instance-0000001f</name>
Aug 16 10:43:26 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:43:26 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:43:26 user nova-compute[73067]:   <metadata>
Aug 16 10:43:26 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:43:26 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:43:26 user nova-compute[73067]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-733484165</nova:name>
Aug 16 10:43:26 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:43:26</nova:creationTime>
Aug 16 10:43:26 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:43:26 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:43:26 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:43:26 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:43:26 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:43:26 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:43:26 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:43:26 user nova-compute[73067]:       <nova:owner>
Aug 16 10:43:26 user nova-compute[73067]:         <nova:user uuid="d3b135edcf064595b8d93052903696a7">tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member</nova:user>
Aug 16 10:43:26 user nova-compute[73067]:         <nova:project uuid="4d03e64450654fd693d6a1bd43017880">tempest-ServerBootFromVolumeStableRescueTest-1973630968</nova:project>
Aug 16 10:43:26 user nova-compute[73067]:       </nova:owner>
Aug 16 10:43:26 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:43:26 user nova-compute[73067]:       <nova:ports>
Aug 16 10:43:26 user nova-compute[73067]:         <nova:port uuid="01254719-e087-47bd-a902-e887841b2a50">
Aug 16 10:43:26 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 10:43:26 user nova-compute[73067]:         </nova:port>
Aug 16 10:43:26 user nova-compute[73067]:       </nova:ports>
Aug 16 10:43:26 user nova-compute[73067]:     </nova:instance>
Aug 16 10:43:26 user nova-compute[73067]:   </metadata>
Aug 16 10:43:26 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:43:26 user nova-compute[73067]:     <system>
Aug 16 10:43:26 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:43:26 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:43:26 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:43:26 user nova-compute[73067]:       <entry name="serial">4bf85594-1255-4383-b359-17ee78c71c6b</entry>
Aug 16 10:43:26 user nova-compute[73067]:       <entry name="uuid">4bf85594-1255-4383-b359-17ee78c71c6b</entry>
Aug 16 10:43:26 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:43:26 user nova-compute[73067]:     </system>
Aug 16 10:43:26 user nova-compute[73067]:   </sysinfo>
Aug 16 10:43:26 user nova-compute[73067]:   <os>
Aug 16 10:43:26 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:43:26 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:43:26 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:43:26 user nova-compute[73067]:   </os>
Aug 16 10:43:26 user nova-compute[73067]:   <features>
Aug 16 10:43:26 user nova-compute[73067]:     <acpi/>
Aug 16 10:43:26 user nova-compute[73067]:     <apic/>
Aug 16 10:43:26 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:43:26 user nova-compute[73067]:   </features>
Aug 16 10:43:26 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:43:26 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:43:26 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:43:26 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:43:26 user nova-compute[73067]:   </clock>
Aug 16 10:43:26 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:43:26 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:43:26 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:43:26 user nova-compute[73067]:   </cpu>
Aug 16 10:43:26 user nova-compute[73067]:   <devices>
Aug 16 10:43:26 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:43:26 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:43:26 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk"/>
Aug 16 10:43:26 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:43:26 user nova-compute[73067]:     </disk>
Aug 16 10:43:26 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:43:26 user nova-compute[73067]:       <mac address="fa:16:3e:5d:b1:58"/>
Aug 16 10:43:26 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:43:26 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:43:26 user nova-compute[73067]:       <target dev="tap01254719-e0"/>
Aug 16 10:43:26 user nova-compute[73067]:     </interface>
Aug 16 10:43:26 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:43:26 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/console.log" append="off"/>
Aug 16 10:43:26 user nova-compute[73067]:     </serial>
Aug 16 10:43:26 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:43:26 user nova-compute[73067]:     <video>
Aug 16 10:43:26 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:43:26 user nova-compute[73067]:     </video>
Aug 16 10:43:26 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:43:26 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:43:26 user nova-compute[73067]:     </rng>
Aug 16 10:43:26 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:43:26 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:43:26 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:43:26 user nova-compute[73067]:     </memballoon>
Aug 16 10:43:26 user nova-compute[73067]:   </devices>
Aug 16 10:43:26 user nova-compute[73067]: </domain>
Aug 16 10:43:26 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-733484165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-733484165',id=31,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-m7tr93lu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:43:24Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=4bf85594-1255-4383-b359-17ee78c71c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=01254719-e087-47bd-a902-e887841b2a50,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01254719-e0') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG os_vif [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=01254719-e087-47bd-a902-e887841b2a50,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01254719-e0') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01254719-e0, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01254719-e0, col_values=(('external_ids', {'iface-id': '01254719-e087-47bd-a902-e887841b2a50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:b1:58', 'vm-uuid': '4bf85594-1255-4383-b359-17ee78c71c6b'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:26 user nova-compute[73067]: INFO os_vif [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=01254719-e087-47bd-a902-e887841b2a50,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01254719-e0')
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No VIF found with MAC fa:16:3e:5d:b1:58, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.network.neutron [req-dc510565-c7b2-4e19-83e1-aa84aa2e25d1 req-7e3371d9-95b1-40b6-8fc5-20f9a376e158 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Updated VIF entry in instance network info cache for port 01254719-e087-47bd-a902-e887841b2a50. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG nova.network.neutron [req-dc510565-c7b2-4e19-83e1-aa84aa2e25d1 req-7e3371d9-95b1-40b6-8fc5-20f9a376e158 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Updating instance_info_cache with network_info: [{"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:43:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dc510565-c7b2-4e19-83e1-aa84aa2e25d1 req-7e3371d9-95b1-40b6-8fc5-20f9a376e158 service nova] Releasing lock "refresh_cache-4bf85594-1255-4383-b359-17ee78c71c6b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:43:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-8b85f84e-72ab-4a3e-8315-d051de1ef708 req-b4d193ca-9078-410c-86a0-fa15398a8ba2 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Received event network-vif-plugged-01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8b85f84e-72ab-4a3e-8315-d051de1ef708 req-b4d193ca-9078-410c-86a0-fa15398a8ba2 service nova] Acquiring lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8b85f84e-72ab-4a3e-8315-d051de1ef708 req-b4d193ca-9078-410c-86a0-fa15398a8ba2 service nova] Lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8b85f84e-72ab-4a3e-8315-d051de1ef708 req-b4d193ca-9078-410c-86a0-fa15398a8ba2 service nova] Lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-8b85f84e-72ab-4a3e-8315-d051de1ef708 req-b4d193ca-9078-410c-86a0-fa15398a8ba2 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] No waiting events found dispatching network-vif-plugged-01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:43:27 user nova-compute[73067]: WARNING nova.compute.manager [req-8b85f84e-72ab-4a3e-8315-d051de1ef708 req-b4d193ca-9078-410c-86a0-fa15398a8ba2 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Received unexpected event network-vif-plugged-01254719-e087-47bd-a902-e887841b2a50 for instance with vm_state building and task_state spawning.
Aug 16 10:43:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:29 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182609.9559155, 4bf85594-1255-4383-b359-17ee78c71c6b => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:43:29 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] VM Resumed (Lifecycle Event)
Aug 16 10:43:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:43:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:43:29 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Instance spawned successfully.
Aug 16 10:43:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:43:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:43:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:43:30 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182609.9591565, 4bf85594-1255-4383-b359-17ee78c71c6b => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:43:30 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] VM Started (Lifecycle Event)
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-1f5cfabf-c37c-40eb-9b41-e6f616f4c769 req-5cbd4951-8478-46ed-8d03-e530f83884df service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Received event network-vif-plugged-01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1f5cfabf-c37c-40eb-9b41-e6f616f4c769 req-5cbd4951-8478-46ed-8d03-e530f83884df service nova] Acquiring lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1f5cfabf-c37c-40eb-9b41-e6f616f4c769 req-5cbd4951-8478-46ed-8d03-e530f83884df service nova] Lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1f5cfabf-c37c-40eb-9b41-e6f616f4c769 req-5cbd4951-8478-46ed-8d03-e530f83884df service nova] Lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-1f5cfabf-c37c-40eb-9b41-e6f616f4c769 req-5cbd4951-8478-46ed-8d03-e530f83884df service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] No waiting events found dispatching network-vif-plugged-01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:43:30 user nova-compute[73067]: WARNING nova.compute.manager [req-1f5cfabf-c37c-40eb-9b41-e6f616f4c769 req-5cbd4951-8478-46ed-8d03-e530f83884df service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Received unexpected event network-vif-plugged-01254719-e087-47bd-a902-e887841b2a50 for instance with vm_state building and task_state spawning.
Aug 16 10:43:30 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:43:30 user nova-compute[73067]: INFO nova.compute.manager [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 16 10:43:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:43:30 user nova-compute[73067]: INFO nova.compute.manager [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Took 7.44 seconds to build instance.
Aug 16 10:43:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7cef9767-e9a7-403d-8ddd-9c172f8aacc7 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "4bf85594-1255-4383-b359-17ee78c71c6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.585s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'flavor' on Instance uuid 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:33 user nova-compute[73067]: INFO nova.compute.manager [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Attaching volume f1792f32-da9b-4f6b-80e7-c36637695f68 to /dev/vdb
Aug 16 10:43:33 user nova-compute[73067]: DEBUG os_brick.utils [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[843c6317-7058-4acc-9aa4-0e5ee0ce8207]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eba9d9-348c-463d-8a1e-7d9e7811f31d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b517b-a010-4f01-bb2c-67b4a03fd18c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ea2e0b-b59a-4fae-b084-4f9130339b5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:43:33 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:43:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10718c0-7ab6-4311-a48e-121b063a5805]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG os_brick.utils [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:43:33 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Updating existing volume attachment record: 43303bb3-bad2-4f7b-9ed4-8aa1b8b2bdae {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:43:35 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Port e7f61fd6-dc62-4568-b823-1a23f93b3e40 binding to destination host user is already ACTIVE {{(pid=73067) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquired lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:36 user nova-compute[73067]: INFO nova.compute.manager [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Rescuing
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquired lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:43:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182602.4459515, 877d406e-ca6f-416f-a569-3cdc1ae545b2 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:43:37 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] VM Stopped (Lifecycle Event)
Aug 16 10:43:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-24069e13-224c-4aee-9f51-fe515ae255b4 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-24069e13-224c-4aee-9f51-fe515ae255b4 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_migrated, current DB power_state: 1, VM power_state: 4 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:37 user nova-compute[73067]: INFO nova.compute.manager [None req-24069e13-224c-4aee-9f51-fe515ae255b4 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] During sync_power_state the instance has a pending task (resize_migrated). Skip.
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updating instance_info_cache with network_info: [{"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG nova.network.neutron [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating instance_info_cache with network_info: [{"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Releasing lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Releasing lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG os_brick.utils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc069a68-e00d-4584-b138-3dcb43f4b159]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5d098b-74a3-47b1-9d18-8cfa3052a2e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaecc357-3fa3-4532-b8f0-a3e2edf6a9e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d334c0c6-eb55-4382-bcaa-3533731ea7be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:43:38 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e11493-52cd-466a-a746-46955f0a9d47]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG os_brick.utils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-f873afd7-92aa-42bf-a3b5-ab5a96509cc3 req-1099af10-31bc-4e41-9bdc-8849202deead service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f873afd7-92aa-42bf-a3b5-ab5a96509cc3 req-1099af10-31bc-4e41-9bdc-8849202deead service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f873afd7-92aa-42bf-a3b5-ab5a96509cc3 req-1099af10-31bc-4e41-9bdc-8849202deead service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f873afd7-92aa-42bf-a3b5-ab5a96509cc3 req-1099af10-31bc-4e41-9bdc-8849202deead service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-f873afd7-92aa-42bf-a3b5-ab5a96509cc3 req-1099af10-31bc-4e41-9bdc-8849202deead service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:43:38 user nova-compute[73067]: WARNING nova.compute.manager [req-f873afd7-92aa-42bf-a3b5-ab5a96509cc3 req-1099af10-31bc-4e41-9bdc-8849202deead service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state active and task_state rescuing.
Aug 16 10:43:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Instance destroyed successfully.
Aug 16 10:43:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Attempting rescue
Aug 16 10:43:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73067) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Instance directory exists: not creating {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 10:43:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Creating image(s)
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.217s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.rescue {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.rescue" returned: 0 in 0.051s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'migration_context' on Instance uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Start _get_guest_xml network_info=[{"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "vif_mac": "fa:16:3e:f7:b2:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'resources' on Instance uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'numa_topology' on Instance uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:43:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2105896710',display_name='tempest-ServerRescueNegativeTestJSON-server-2105896710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2105896710',id=27,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:38:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-enqd2hwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:38:59Z,user_data=None,user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=80c5b266-d257-447f-9c43-49e9a5455aef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "vif_mac": "fa:16:3e:f7:b2:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "vif_mac": "fa:16:3e:f7:b2:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b2:37,bridge_name='br-int',has_traffic_filtering=True,id=cd4abca0-e551-48f4-8d79-ce2ca1665dde,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4abca0-e5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'pci_devices' on Instance uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:43:39 user nova-compute[73067]:   <uuid>80c5b266-d257-447f-9c43-49e9a5455aef</uuid>
Aug 16 10:43:39 user nova-compute[73067]:   <name>instance-0000001b</name>
Aug 16 10:43:39 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:43:39 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:43:39 user nova-compute[73067]:   <metadata>
Aug 16 10:43:39 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:43:39 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:43:39 user nova-compute[73067]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2105896710</nova:name>
Aug 16 10:43:39 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:43:39</nova:creationTime>
Aug 16 10:43:39 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:43:39 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:43:39 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:43:39 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:43:39 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:43:39 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:43:39 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:43:39 user nova-compute[73067]:       <nova:owner>
Aug 16 10:43:39 user nova-compute[73067]:         <nova:user uuid="735a6aba3e974eb29e45ec3a7aa8c5cc">tempest-ServerRescueNegativeTestJSON-411494625-project-member</nova:user>
Aug 16 10:43:39 user nova-compute[73067]:         <nova:project uuid="687a889259b948fa985ce7c9b84b030a">tempest-ServerRescueNegativeTestJSON-411494625</nova:project>
Aug 16 10:43:39 user nova-compute[73067]:       </nova:owner>
Aug 16 10:43:39 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:43:39 user nova-compute[73067]:       <nova:ports>
Aug 16 10:43:39 user nova-compute[73067]:         <nova:port uuid="cd4abca0-e551-48f4-8d79-ce2ca1665dde">
Aug 16 10:43:39 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 10:43:39 user nova-compute[73067]:         </nova:port>
Aug 16 10:43:39 user nova-compute[73067]:       </nova:ports>
Aug 16 10:43:39 user nova-compute[73067]:     </nova:instance>
Aug 16 10:43:39 user nova-compute[73067]:   </metadata>
Aug 16 10:43:39 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:43:39 user nova-compute[73067]:     <system>
Aug 16 10:43:39 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:43:39 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:43:39 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:43:39 user nova-compute[73067]:       <entry name="serial">80c5b266-d257-447f-9c43-49e9a5455aef</entry>
Aug 16 10:43:39 user nova-compute[73067]:       <entry name="uuid">80c5b266-d257-447f-9c43-49e9a5455aef</entry>
Aug 16 10:43:39 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:43:39 user nova-compute[73067]:     </system>
Aug 16 10:43:39 user nova-compute[73067]:   </sysinfo>
Aug 16 10:43:39 user nova-compute[73067]:   <os>
Aug 16 10:43:39 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:43:39 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:43:39 user nova-compute[73067]:   </os>
Aug 16 10:43:39 user nova-compute[73067]:   <features>
Aug 16 10:43:39 user nova-compute[73067]:     <acpi/>
Aug 16 10:43:39 user nova-compute[73067]:     <apic/>
Aug 16 10:43:39 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:43:39 user nova-compute[73067]:   </features>
Aug 16 10:43:39 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:43:39 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:43:39 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:43:39 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:43:39 user nova-compute[73067]:   </clock>
Aug 16 10:43:39 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:43:39 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:43:39 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:43:39 user nova-compute[73067]:   </cpu>
Aug 16 10:43:39 user nova-compute[73067]:   <devices>
Aug 16 10:43:39 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:43:39 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:43:39 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.rescue"/>
Aug 16 10:43:39 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:43:39 user nova-compute[73067]:     </disk>
Aug 16 10:43:39 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:43:39 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:43:39 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk"/>
Aug 16 10:43:39 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:43:39 user nova-compute[73067]:     </disk>
Aug 16 10:43:39 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:43:39 user nova-compute[73067]:       <mac address="fa:16:3e:f7:b2:37"/>
Aug 16 10:43:39 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:43:39 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:43:39 user nova-compute[73067]:       <target dev="tapcd4abca0-e5"/>
Aug 16 10:43:39 user nova-compute[73067]:     </interface>
Aug 16 10:43:39 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:43:39 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/console.log" append="off"/>
Aug 16 10:43:39 user nova-compute[73067]:     </serial>
Aug 16 10:43:39 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:43:39 user nova-compute[73067]:     <video>
Aug 16 10:43:39 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:43:39 user nova-compute[73067]:     </video>
Aug 16 10:43:39 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:43:39 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:43:39 user nova-compute[73067]:     </rng>
Aug 16 10:43:39 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:43:39 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:43:39 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:43:39 user nova-compute[73067]:     </memballoon>
Aug 16 10:43:39 user nova-compute[73067]:   </devices>
Aug 16 10:43:39 user nova-compute[73067]: </domain>
Aug 16 10:43:39 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:43:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Instance destroyed successfully.
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No VIF found with MAC fa:16:3e:f7:b2:37, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-deaf24fd-2a6c-40fc-8a1d-82ffd1b19c0c req-35bf6f84-a92b-456d-aac7-3a79127b7d96 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-deaf24fd-2a6c-40fc-8a1d-82ffd1b19c0c req-35bf6f84-a92b-456d-aac7-3a79127b7d96 service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-deaf24fd-2a6c-40fc-8a1d-82ffd1b19c0c req-35bf6f84-a92b-456d-aac7-3a79127b7d96 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-deaf24fd-2a6c-40fc-8a1d-82ffd1b19c0c req-35bf6f84-a92b-456d-aac7-3a79127b7d96 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-deaf24fd-2a6c-40fc-8a1d-82ffd1b19c0c req-35bf6f84-a92b-456d-aac7-3a79127b7d96 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:43:44 user nova-compute[73067]: WARNING nova.compute.manager [req-deaf24fd-2a6c-40fc-8a1d-82ffd1b19c0c req-35bf6f84-a92b-456d-aac7-3a79127b7d96 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state active and task_state rescuing.
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:43:44 user nova-compute[73067]: WARNING nova.compute.manager [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state active and task_state rescuing.
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:43:44 user nova-compute[73067]: WARNING nova.compute.manager [req-8a5a4f7c-8298-48ae-b609-112e89fd8561 req-03877455-41d3-4808-99a9-49fc4061bae1 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state active and task_state rescuing.
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for 80c5b266-d257-447f-9c43-49e9a5455aef due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182623.8076622, 80c5b266-d257-447f-9c43-49e9a5455aef => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:43:44 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] VM Resumed (Lifecycle Event)
Aug 16 10:43:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e6add7f5-22a4-4619-825a-7589b81ecdec tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:43:44 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:43:44 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7833MB free_disk=25.243553161621094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:43:44 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182623.807953, 80c5b266-d257-447f-9c43-49e9a5455aef => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:43:44 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] VM Started (Lifecycle Event)
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Applying migration context for instance 877d406e-ca6f-416f-a569-3cdc1ae545b2 as it has an incoming, in-progress migration 8482254a-f9aa-4602-988d-1587375801c1. Migration status is post-migrating {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 10:43:44 user nova-compute[73067]: INFO nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating resource usage from migration 8482254a-f9aa-4602-988d-1587375801c1
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Migration 8482254a-f9aa-4602-988d-1587375801c1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 877d406e-ca6f-416f-a569-3cdc1ae545b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf85594-1255-4383-b359-17ee78c71c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:43:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:45 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:43:45 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:43:45 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:43:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:43:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 311f3d35-c279-4b63-b3e1-7528c30ac659 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNOwTrhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:43:46 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:43:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:43:46 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:43:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:43:46 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e7a9f1-853b-468a-90fd-562d211836f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:43:46 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4673157c-29a8-4fdd-b080-12ed4e2e312e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68] added
Aug 16 10:43:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[935d5697-927e-4de3-8d5a-71a8acdc8c17]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9bad07-c40a-433e-a7dd-fc0f4d4137a6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNOwTrhU {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNOwTrhU" returned: 0 in 0.030s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d015317-8b65-4a7a-ac53-3b453177c430]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNOwTrhU'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7e269e-eb8d-435a-b0e2-1fa6124eebe7]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ecfccd-a4e7-4252-a1d4-76fa5dff7939]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:47 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:47 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:47 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:47 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updating instance_info_cache with network_info: [{"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-311f3d35-c279-4b63-b3e1-7528c30ac659" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cc3a81-8e50-4985-a900-9e4f41320574]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68, portal: 172.16.0.220,3260]
Aug 16 10:43:47 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68, portal: 172.16.0.220,3260] successful.
Aug 16 10:43:47 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c554e9e5-ae4f-4218-94b0-5279dc07bcb4]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3ee94d-eeab-415a-9a8d-3f915c1b93f1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:47 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:47 user nova-compute[73067]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 (non-flash)
Aug 16 10:43:47 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:47 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:47 user nova-compute[73067]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 (non-flash)
Aug 16 10:43:47 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[623fd6e0-eb94-4621-b386-909612f448c7]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:43:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNOwTrhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:43:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:43:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '26561343035643064', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:43:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561343035643064', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:43:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'flavor' on Instance uuid 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:43:48 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:43:48 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:43:48 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:43:48 user nova-compute[73067]:   <serial>f1792f32-da9b-4f6b-80e7-c36637695f68</serial>
Aug 16 10:43:48 user nova-compute[73067]: </disk>
Aug 16 10:43:48 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:43:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:43:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:43:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No VIF found with MAC fa:16:3e:f2:8f:5b, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:43:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-46e4a830-5586-46ec-a15e-89ac4b92d0c2 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.587s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:50 user nova-compute[73067]: INFO nova.compute.manager [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Detaching volume f1792f32-da9b-4f6b-80e7-c36637695f68
Aug 16 10:43:50 user nova-compute[73067]: INFO nova.virt.block_device [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Attempting to driver detach volume f1792f32-da9b-4f6b-80e7-c36637695f68 from mountpoint /dev/vdb
Aug 16 10:43:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Attempting to detach device vdb from instance 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:43:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:43:50 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:43:50 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:43:50 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:43:50 user nova-compute[73067]:   <serial>f1792f32-da9b-4f6b-80e7-c36637695f68</serial>
Aug 16 10:43:50 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:43:50 user nova-compute[73067]: </disk>
Aug 16 10:43:50 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:43:50 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully detached device vdb from instance 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 from the persistent domain config.
Aug 16 10:43:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:43:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:43:50 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:43:50 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:43:50 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:43:50 user nova-compute[73067]:   <serial>f1792f32-da9b-4f6b-80e7-c36637695f68</serial>
Aug 16 10:43:50 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:43:50 user nova-compute[73067]: </disk>
Aug 16 10:43:50 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182631.0848622, 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:43:51 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully detached device vdb from instance 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 from the live domain config.
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNOwTrhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:43:51 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[02476af8-edc9-4310-8e1f-95e4b6161e89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9633855-e43e-4015-ae73-dd20901b861c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:51 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:51 user nova-compute[73067]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 (non-flash)
Aug 16 10:43:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:51 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:51 user nova-compute[73067]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 (non-flash)
Aug 16 10:43:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35843b7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Starting finish_migration {{(pid=73067) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Instance directory exists: not creating {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 10:43:51 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Creating image(s)
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Ensure instance console log exists: /opt/stack/data/nova/instances/877d406e-ca6f-416f-a569-3cdc1ae545b2/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Start _get_guest_xml network_info=[{"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-681058576-network", "vif_mac": "fa:16:3e:4a:6a:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJWqLcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '877d406e-ca6f-416f-a569-3cdc1ae545b2', 'attached_at': '2023-08-16T10:43:51.000000', 'detached_at': '', 'volume_id': '7132cfff-0821-4477-b0c2-07ee5c870273', 'serial': '7132cfff-0821-4477-b0c2-07ee5c870273'}, 'delete_on_termination': True, 'attachment_id': 'b8711fea-1c2d-44fe-8ab7-fac0b1051c62', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:43:51 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b001aae-4033-492a-ba06-fb5f845f0d51]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.objects.instance [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'vcpu_model' on Instance uuid 877d406e-ca6f-416f-a569-3cdc1ae545b2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f3ed81-0e20-4b1b-9811-4b1a0ad3f6de]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJWqLcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:43:51 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db05f3-d997-410b-b760-efa3cee3f0b9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b375d05-b08e-4092-adb8-ed974f6f856d]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3466eb4-86ee-46f5-9dff-9ea13046e83d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5cb625-f540-4d11-9c6c-23c25ec9f561]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68, portal: 172.16.0.220,3260]
Aug 16 10:43:51 user nova-compute[73067]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68, portal: 172.16.0.220,3260] successful.
Aug 16 10:43:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1792f32-da9b-4f6b-80e7-c36637695f68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8e4d40-61fc-4134-9458-c46106a48205]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] <== disconnect_volume: return (331ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.168s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:43:51 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:43:51 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[85662734-39a1-40e5-a296-6cbbf1f42c58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:43:51 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0787ef-1d8a-4992-b719-ac40fe4f2b03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273] added
Aug 16 10:43:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b6c3e1-9f9c-4541-86f2-a753a4074907]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf62894-26d4-47a6-b5f1-df5e8915477a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJWqLcps {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJWqLcps" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2efddf1-62c3-4b72-838d-5e483ffe14be]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OJWqLcps'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5be864-5cf6-4ef8-80d7-d7fcbd848ca5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a2ec95-4d8f-4123-bfd8-ba5ebe761d75]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:51 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:51 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[753ac728-7288-488c-96ba-3c368c3074a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260]
Aug 16 10:43:51 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260] successful.
Aug 16 10:43:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba4198b-4f94-4472-a657-b413abd72370]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b7da69-ef72-4abf-aa35-731f1fadb710]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:51 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:51 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:43:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:51 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:51 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:43:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad4549b-c0cb-4e38-b07d-8fbf7e719053]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:43:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJWqLcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.objects.instance [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'flavor' on Instance uuid 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bd602b77-f4e0-43b8-91c2-61696c70740b tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.966s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '26530613664643164', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530613664643164', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-488171748',display_name='tempest-ServerActionsTestOtherA-server-488171748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-488171748',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhgla1EGudnUgMo8sp69bGCzI9KExAhN9Vh+LGcPb7ZOjWlvBFg2zY0lGwEq2wsMYNd+BUSx+LuV7e4QllhSz+KH5UmhKYnFLZT6xPiJcUN2ahr8Bxzv1S1RvOd3h/nwA==',key_name='tempest-keypair-88160896',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-yv50xdsr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:43:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=877d406e-ca6f-416f-a569-3cdc1ae545b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-681058576-network", "vif_mac": "fa:16:3e:4a:6a:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-681058576-network", "vif_mac": "fa:16:3e:4a:6a:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:43:52 user nova-compute[73067]:   <uuid>877d406e-ca6f-416f-a569-3cdc1ae545b2</uuid>
Aug 16 10:43:52 user nova-compute[73067]:   <name>instance-0000001d</name>
Aug 16 10:43:52 user nova-compute[73067]:   <memory>2097152</memory>
Aug 16 10:43:52 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:43:52 user nova-compute[73067]:   <metadata>
Aug 16 10:43:52 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:43:52 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:43:52 user nova-compute[73067]:       <nova:name>tempest-ServerActionsTestOtherA-server-488171748</nova:name>
Aug 16 10:43:52 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:43:51</nova:creationTime>
Aug 16 10:43:52 user nova-compute[73067]:       <nova:flavor name="m1.small">
Aug 16 10:43:52 user nova-compute[73067]:         <nova:memory>2048</nova:memory>
Aug 16 10:43:52 user nova-compute[73067]:         <nova:disk>20</nova:disk>
Aug 16 10:43:52 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:43:52 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:43:52 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:43:52 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:43:52 user nova-compute[73067]:       <nova:owner>
Aug 16 10:43:52 user nova-compute[73067]:         <nova:user uuid="9e4cbf9cec1c4c438adbbab6bd7f794c">tempest-ServerActionsTestOtherA-1833692287-project-member</nova:user>
Aug 16 10:43:52 user nova-compute[73067]:         <nova:project uuid="1b7b37f1cdfe41ddb6545c23a5b5c8b4">tempest-ServerActionsTestOtherA-1833692287</nova:project>
Aug 16 10:43:52 user nova-compute[73067]:       </nova:owner>
Aug 16 10:43:52 user nova-compute[73067]:       <nova:ports>
Aug 16 10:43:52 user nova-compute[73067]:         <nova:port uuid="e7f61fd6-dc62-4568-b823-1a23f93b3e40">
Aug 16 10:43:52 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 10:43:52 user nova-compute[73067]:         </nova:port>
Aug 16 10:43:52 user nova-compute[73067]:       </nova:ports>
Aug 16 10:43:52 user nova-compute[73067]:     </nova:instance>
Aug 16 10:43:52 user nova-compute[73067]:   </metadata>
Aug 16 10:43:52 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:43:52 user nova-compute[73067]:     <system>
Aug 16 10:43:52 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:43:52 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:43:52 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:43:52 user nova-compute[73067]:       <entry name="serial">877d406e-ca6f-416f-a569-3cdc1ae545b2</entry>
Aug 16 10:43:52 user nova-compute[73067]:       <entry name="uuid">877d406e-ca6f-416f-a569-3cdc1ae545b2</entry>
Aug 16 10:43:52 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:43:52 user nova-compute[73067]:     </system>
Aug 16 10:43:52 user nova-compute[73067]:   </sysinfo>
Aug 16 10:43:52 user nova-compute[73067]:   <os>
Aug 16 10:43:52 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:43:52 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:43:52 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:43:52 user nova-compute[73067]:   </os>
Aug 16 10:43:52 user nova-compute[73067]:   <features>
Aug 16 10:43:52 user nova-compute[73067]:     <acpi/>
Aug 16 10:43:52 user nova-compute[73067]:     <apic/>
Aug 16 10:43:52 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:43:52 user nova-compute[73067]:   </features>
Aug 16 10:43:52 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:43:52 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:43:52 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:43:52 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:43:52 user nova-compute[73067]:   </clock>
Aug 16 10:43:52 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:43:52 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:43:52 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:43:52 user nova-compute[73067]:   </cpu>
Aug 16 10:43:52 user nova-compute[73067]:   <devices>
Aug 16 10:43:52 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:43:52 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:43:52 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 10:43:52 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:43:52 user nova-compute[73067]:       <serial>7132cfff-0821-4477-b0c2-07ee5c870273</serial>
Aug 16 10:43:52 user nova-compute[73067]:     </disk>
Aug 16 10:43:52 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:43:52 user nova-compute[73067]:       <mac address="fa:16:3e:4a:6a:a1"/>
Aug 16 10:43:52 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:43:52 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:43:52 user nova-compute[73067]:       <target dev="tape7f61fd6-dc"/>
Aug 16 10:43:52 user nova-compute[73067]:     </interface>
Aug 16 10:43:52 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:43:52 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/877d406e-ca6f-416f-a569-3cdc1ae545b2/console.log" append="off"/>
Aug 16 10:43:52 user nova-compute[73067]:     </serial>
Aug 16 10:43:52 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:43:52 user nova-compute[73067]:     <video>
Aug 16 10:43:52 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:43:52 user nova-compute[73067]:     </video>
Aug 16 10:43:52 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:43:52 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:43:52 user nova-compute[73067]:     </rng>
Aug 16 10:43:52 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:43:52 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:43:52 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:43:52 user nova-compute[73067]:     </memballoon>
Aug 16 10:43:52 user nova-compute[73067]:   </devices>
Aug 16 10:43:52 user nova-compute[73067]: </domain>
Aug 16 10:43:52 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-488171748',display_name='tempest-ServerActionsTestOtherA-server-488171748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-488171748',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhgla1EGudnUgMo8sp69bGCzI9KExAhN9Vh+LGcPb7ZOjWlvBFg2zY0lGwEq2wsMYNd+BUSx+LuV7e4QllhSz+KH5UmhKYnFLZT6xPiJcUN2ahr8Bxzv1S1RvOd3h/nwA==',key_name='tempest-keypair-88160896',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-yv50xdsr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:43:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=877d406e-ca6f-416f-a569-3cdc1ae545b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-681058576-network", "vif_mac": "fa:16:3e:4a:6a:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-681058576-network", "vif_mac": "fa:16:3e:4a:6a:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG os_vif [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7f61fd6-dc, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7f61fd6-dc, col_values=(('external_ids', {'iface-id': 'e7f61fd6-dc62-4568-b823-1a23f93b3e40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:6a:a1', 'vm-uuid': '877d406e-ca6f-416f-a569-3cdc1ae545b2'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:43:52 user nova-compute[73067]: INFO os_vif [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc')
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:43:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] No VIF found with MAC fa:16:3e:4a:6a:a1, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:43:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:54 user nova-compute[73067]: DEBUG nova.compute.manager [req-e9b3e98f-63e1-407d-9c74-347e58fc2da0 req-c2bcca3d-9744-461f-b77e-2fcd083a8c6f service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e9b3e98f-63e1-407d-9c74-347e58fc2da0 req-c2bcca3d-9744-461f-b77e-2fcd083a8c6f service nova] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e9b3e98f-63e1-407d-9c74-347e58fc2da0 req-c2bcca3d-9744-461f-b77e-2fcd083a8c6f service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e9b3e98f-63e1-407d-9c74-347e58fc2da0 req-c2bcca3d-9744-461f-b77e-2fcd083a8c6f service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:54 user nova-compute[73067]: DEBUG nova.compute.manager [req-e9b3e98f-63e1-407d-9c74-347e58fc2da0 req-c2bcca3d-9744-461f-b77e-2fcd083a8c6f service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] No waiting events found dispatching network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:43:54 user nova-compute[73067]: WARNING nova.compute.manager [req-e9b3e98f-63e1-407d-9c74-347e58fc2da0 req-c2bcca3d-9744-461f-b77e-2fcd083a8c6f service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received unexpected event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 for instance with vm_state active and task_state resize_finish.
Aug 16 10:43:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182636.4629557, 877d406e-ca6f-416f-a569-3cdc1ae545b2 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:43:56 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] VM Resumed (Lifecycle Event)
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:43:56 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Instance running successfully.
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Failed to set time: agent not configured {{(pid=73067) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b3147d17-e2f7-4047-a8b4-9bbcfd4fcc9a tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] finish_migration finished successfully. {{(pid=73067) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:43:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:56 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182636.466862, 877d406e-ca6f-416f-a569-3cdc1ae545b2 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:43:56 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] VM Started (Lifecycle Event)
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:43:56 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-fcc0fa42-de6e-4a4b-a7f6-5a7524b71b93 req-5c40ad16-f152-4969-8d50-f045bf85c2ae service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:43:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fcc0fa42-de6e-4a4b-a7f6-5a7524b71b93 req-5c40ad16-f152-4969-8d50-f045bf85c2ae service nova] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fcc0fa42-de6e-4a4b-a7f6-5a7524b71b93 req-5c40ad16-f152-4969-8d50-f045bf85c2ae service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fcc0fa42-de6e-4a4b-a7f6-5a7524b71b93 req-5c40ad16-f152-4969-8d50-f045bf85c2ae service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:43:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-fcc0fa42-de6e-4a4b-a7f6-5a7524b71b93 req-5c40ad16-f152-4969-8d50-f045bf85c2ae service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] No waiting events found dispatching network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:43:56 user nova-compute[73067]: WARNING nova.compute.manager [req-fcc0fa42-de6e-4a4b-a7f6-5a7524b71b93 req-5c40ad16-f152-4969-8d50-f045bf85c2ae service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received unexpected event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 for instance with vm_state active and task_state resize_finish.
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:43:57 user nova-compute[73067]: INFO nova.compute.manager [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Detaching volume 506bb603-39bf-468d-82d5-a075eea2e91f
Aug 16 10:43:57 user nova-compute[73067]: INFO nova.virt.block_device [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Attempting to driver detach volume 506bb603-39bf-468d-82d5-a075eea2e91f from mountpoint /dev/vdc
Aug 16 10:43:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Attempting to detach device vdc from instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:43:57 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:43:57 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:43:57 user nova-compute[73067]:   <target dev="vdc" bus="virtio"/>
Aug 16 10:43:57 user nova-compute[73067]:   <serial>506bb603-39bf-468d-82d5-a075eea2e91f</serial>
Aug 16 10:43:57 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 10:43:57 user nova-compute[73067]: </disk>
Aug 16 10:43:57 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:43:57 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Successfully detached device vdc from instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 from the persistent domain config.
Aug 16 10:43:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:43:57 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:43:57 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:43:57 user nova-compute[73067]:   <target dev="vdc" bus="virtio"/>
Aug 16 10:43:57 user nova-compute[73067]:   <serial>506bb603-39bf-468d-82d5-a075eea2e91f</serial>
Aug 16 10:43:57 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 10:43:57 user nova-compute[73067]: </disk>
Aug 16 10:43:57 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182637.838835, 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:43:57 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Successfully detached device vdc from instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 from the live domain config.
Aug 16 10:43:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wczJUZyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:43:57 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:43:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae43def-9b6b-4e9b-ae9f-a7a68c26475b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd645f7-0b89-4f03-ab44-59316879708f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:57 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:57 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:43:57 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:43:57 user nova-compute[73067]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f (non-flash)
Aug 16 10:43:57 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:43:57 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f356432b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d821c09-3961-4f27-aa15-9cf1a347e57c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[64214bcc-bc11-4109-a279-f377ce2d7c5e]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:43:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[878ed772-2236-41b8-b4a0-28eac16aa41c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fbd8d2-0264-4ede-bb02-713b9d16edbc]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3b7672-68b2-4b07-9b56-73259b7be71e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b5e1c4-9238-4d19-9114-d37da18516cc]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f, portal: 172.16.0.220,3260]
Aug 16 10:43:58 user nova-compute[73067]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f, portal: 172.16.0.220,3260] successful.
Aug 16 10:43:58 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506bb603-39bf-468d-82d5-a075eea2e91f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[267c97cf-03e7-4f62-a5ab-470f125e8086]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] <== disconnect_volume: return (357ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:43:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:43:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:43:59 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'flavor' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:43:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ae1be416-d7b6-4163-9740-e002979eed05 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.958s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:44:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:44:05 user nova-compute[73067]: INFO nova.compute.claims [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Claim successful on node user
Aug 16 10:44:06 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG nova.network.neutron [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:44:06 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:44:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG nova.policy [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61f8d65b293a41acb5aca991e2e41d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5f36d1e3e24603bf6832c3b46a2942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:44:06 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Creating image(s)
Aug 16 10:44:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "/opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "/opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "be996f01d0363bbcc58b967b29afa7c9d729e7db" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "be996f01d0363bbcc58b967b29afa7c9d729e7db" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db.part --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db.part --force-share --output=json" returned: 0 in 0.263s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:07 user nova-compute[73067]: DEBUG nova.virt.images [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] 4a41081d-c9ae-4543-be55-100c2e2697d5 was qcow2, converting to raw {{(pid=73067) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 10:44:07 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:44:07 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db.part /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db.converted {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:07 user nova-compute[73067]: DEBUG nova.network.neutron [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Successfully created port: 22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db.part /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db.converted" returned: 0 in 0.333s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db.converted --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "be996f01d0363bbcc58b967b29afa7c9d729e7db" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.981s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "be996f01d0363bbcc58b967b29afa7c9d729e7db" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "be996f01d0363bbcc58b967b29afa7c9d729e7db" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db --force-share --output=json" returned: 0 in 0.200s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db,backing_fmt=raw /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db,backing_fmt=raw /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk 1073741824" returned: 0 in 0.069s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "be996f01d0363bbcc58b967b29afa7c9d729e7db" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db --force-share --output=json" returned: 0 in 0.250s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Cannot resize image /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.objects.instance [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'migration_context' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Ensure instance console log exists: /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.network.neutron [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Successfully updated port: 22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquired lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.network.neutron [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-7b957d33-7d47-4bc9-99cf-ff25c99c2185 req-fea66b00-0457-441e-9fc1-ef3095e88d05 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-changed-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-7b957d33-7d47-4bc9-99cf-ff25c99c2185 req-fea66b00-0457-441e-9fc1-ef3095e88d05 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Refreshing instance network info cache due to event network-changed-22be01f1-3ab2-4867-a8f9-b1a050be6ff6. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7b957d33-7d47-4bc9-99cf-ff25c99c2185 req-fea66b00-0457-441e-9fc1-ef3095e88d05 service nova] Acquiring lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.network.neutron [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.network.neutron [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updating instance_info_cache with network_info: [{"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Releasing lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Instance network_info: |[{"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7b957d33-7d47-4bc9-99cf-ff25c99c2185 req-fea66b00-0457-441e-9fc1-ef3095e88d05 service nova] Acquired lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.network.neutron [req-7b957d33-7d47-4bc9-99cf-ff25c99c2185 req-fea66b00-0457-441e-9fc1-ef3095e88d05 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Refreshing network info cache for port 22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Start _get_guest_xml network_info=[{"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:44:03Z,direct_url=<?>,disk_format='qcow2',id=4a41081d-c9ae-4543-be55-100c2e2697d5,min_disk=0,min_ram=0,name='tempest-scenario-img--292129369',owner='fd5f36d1e3e24603bf6832c3b46a2942',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:44:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '4a41081d-c9ae-4543-be55-100c2e2697d5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:44:09 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:44:09 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:44:03Z,direct_url=<?>,disk_format='qcow2',id=4a41081d-c9ae-4543-be55-100c2e2697d5,min_disk=0,min_ram=0,name='tempest-scenario-img--292129369',owner='fd5f36d1e3e24603bf6832c3b46a2942',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:44:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1700906205',display_name='tempest-TestMinimumBasicScenario-server-1700906205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1700906205',id=32,image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgkiw20ibEVvyBP1aNII5Kpem4blK8hbWaXd0J7BdzDTr8pVYG1tDfn0jp74MsRSRZcBd+VsmMI/mvuaAIiw2eow7xaOLfJKpYvP+OZtSK6g70MwoLrjfNaYzUkMxS8FA==',key_name='tempest-TestMinimumBasicScenario-1462671997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd5f36d1e3e24603bf6832c3b46a2942',ramdisk_id='',reservation_id='r-wrcz371w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1702842771',owner_user_name='tempest-TestMinimumBasicScenario-1702842771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:44:06Z,user_data=None,user_id='61f8d65b293a41acb5aca991e2e41d57',uuid=3d166e9d-e05d-4378-b14b-0c10318490b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converting VIF {"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.objects.instance [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:44:09 user nova-compute[73067]:   <uuid>3d166e9d-e05d-4378-b14b-0c10318490b8</uuid>
Aug 16 10:44:09 user nova-compute[73067]:   <name>instance-00000020</name>
Aug 16 10:44:09 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:44:09 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:44:09 user nova-compute[73067]:   <metadata>
Aug 16 10:44:09 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:44:09 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:44:09 user nova-compute[73067]:       <nova:name>tempest-TestMinimumBasicScenario-server-1700906205</nova:name>
Aug 16 10:44:09 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:44:09</nova:creationTime>
Aug 16 10:44:09 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:44:09 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:44:09 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:44:09 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:44:09 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:44:09 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:44:09 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:44:09 user nova-compute[73067]:       <nova:owner>
Aug 16 10:44:09 user nova-compute[73067]:         <nova:user uuid="61f8d65b293a41acb5aca991e2e41d57">tempest-TestMinimumBasicScenario-1702842771-project-member</nova:user>
Aug 16 10:44:09 user nova-compute[73067]:         <nova:project uuid="fd5f36d1e3e24603bf6832c3b46a2942">tempest-TestMinimumBasicScenario-1702842771</nova:project>
Aug 16 10:44:09 user nova-compute[73067]:       </nova:owner>
Aug 16 10:44:09 user nova-compute[73067]:       <nova:root type="image" uuid="4a41081d-c9ae-4543-be55-100c2e2697d5"/>
Aug 16 10:44:09 user nova-compute[73067]:       <nova:ports>
Aug 16 10:44:09 user nova-compute[73067]:         <nova:port uuid="22be01f1-3ab2-4867-a8f9-b1a050be6ff6">
Aug 16 10:44:09 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 10:44:09 user nova-compute[73067]:         </nova:port>
Aug 16 10:44:09 user nova-compute[73067]:       </nova:ports>
Aug 16 10:44:09 user nova-compute[73067]:     </nova:instance>
Aug 16 10:44:09 user nova-compute[73067]:   </metadata>
Aug 16 10:44:09 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:44:09 user nova-compute[73067]:     <system>
Aug 16 10:44:09 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:44:09 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:44:09 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:44:09 user nova-compute[73067]:       <entry name="serial">3d166e9d-e05d-4378-b14b-0c10318490b8</entry>
Aug 16 10:44:09 user nova-compute[73067]:       <entry name="uuid">3d166e9d-e05d-4378-b14b-0c10318490b8</entry>
Aug 16 10:44:09 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:44:09 user nova-compute[73067]:     </system>
Aug 16 10:44:09 user nova-compute[73067]:   </sysinfo>
Aug 16 10:44:09 user nova-compute[73067]:   <os>
Aug 16 10:44:09 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:44:09 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:44:09 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:44:09 user nova-compute[73067]:   </os>
Aug 16 10:44:09 user nova-compute[73067]:   <features>
Aug 16 10:44:09 user nova-compute[73067]:     <acpi/>
Aug 16 10:44:09 user nova-compute[73067]:     <apic/>
Aug 16 10:44:09 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:44:09 user nova-compute[73067]:   </features>
Aug 16 10:44:09 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:44:09 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:44:09 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:44:09 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:44:09 user nova-compute[73067]:   </clock>
Aug 16 10:44:09 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:44:09 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:44:09 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:44:09 user nova-compute[73067]:   </cpu>
Aug 16 10:44:09 user nova-compute[73067]:   <devices>
Aug 16 10:44:09 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:44:09 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:44:09 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk"/>
Aug 16 10:44:09 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:44:09 user nova-compute[73067]:     </disk>
Aug 16 10:44:09 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:44:09 user nova-compute[73067]:       <mac address="fa:16:3e:88:b8:d4"/>
Aug 16 10:44:09 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:44:09 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:44:09 user nova-compute[73067]:       <target dev="tap22be01f1-3a"/>
Aug 16 10:44:09 user nova-compute[73067]:     </interface>
Aug 16 10:44:09 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:44:09 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/console.log" append="off"/>
Aug 16 10:44:09 user nova-compute[73067]:     </serial>
Aug 16 10:44:09 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:44:09 user nova-compute[73067]:     <video>
Aug 16 10:44:09 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:44:09 user nova-compute[73067]:     </video>
Aug 16 10:44:09 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:44:09 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:44:09 user nova-compute[73067]:     </rng>
Aug 16 10:44:09 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:44:09 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:44:09 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:44:09 user nova-compute[73067]:     </memballoon>
Aug 16 10:44:09 user nova-compute[73067]:   </devices>
Aug 16 10:44:09 user nova-compute[73067]: </domain>
Aug 16 10:44:09 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1700906205',display_name='tempest-TestMinimumBasicScenario-server-1700906205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1700906205',id=32,image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgkiw20ibEVvyBP1aNII5Kpem4blK8hbWaXd0J7BdzDTr8pVYG1tDfn0jp74MsRSRZcBd+VsmMI/mvuaAIiw2eow7xaOLfJKpYvP+OZtSK6g70MwoLrjfNaYzUkMxS8FA==',key_name='tempest-TestMinimumBasicScenario-1462671997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd5f36d1e3e24603bf6832c3b46a2942',ramdisk_id='',reservation_id='r-wrcz371w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1702842771',owner_user_name='tempest-TestMinimumBasicScenario-1702842771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:44:06Z,user_data=None,user_id='61f8d65b293a41acb5aca991e2e41d57',uuid=3d166e9d-e05d-4378-b14b-0c10318490b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converting VIF {"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG os_vif [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22be01f1-3a, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22be01f1-3a, col_values=(('external_ids', {'iface-id': '22be01f1-3ab2-4867-a8f9-b1a050be6ff6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:b8:d4', 'vm-uuid': '3d166e9d-e05d-4378-b14b-0c10318490b8'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:09 user nova-compute[73067]: INFO os_vif [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a')
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:44:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] No VIF found with MAC fa:16:3e:88:b8:d4, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:44:10 user nova-compute[73067]: DEBUG nova.network.neutron [req-7b957d33-7d47-4bc9-99cf-ff25c99c2185 req-fea66b00-0457-441e-9fc1-ef3095e88d05 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updated VIF entry in instance network info cache for port 22be01f1-3ab2-4867-a8f9-b1a050be6ff6. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:44:10 user nova-compute[73067]: DEBUG nova.network.neutron [req-7b957d33-7d47-4bc9-99cf-ff25c99c2185 req-fea66b00-0457-441e-9fc1-ef3095e88d05 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updating instance_info_cache with network_info: [{"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:44:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-7b957d33-7d47-4bc9-99cf-ff25c99c2185 req-fea66b00-0457-441e-9fc1-ef3095e88d05 service nova] Releasing lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:44:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-b509acc3-64fc-4203-9a37-3f6997361e3a req-4c83dc92-c2b3-414d-b1fc-c18978e138ba service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:44:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b509acc3-64fc-4203-9a37-3f6997361e3a req-4c83dc92-c2b3-414d-b1fc-c18978e138ba service nova] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b509acc3-64fc-4203-9a37-3f6997361e3a req-4c83dc92-c2b3-414d-b1fc-c18978e138ba service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b509acc3-64fc-4203-9a37-3f6997361e3a req-4c83dc92-c2b3-414d-b1fc-c18978e138ba service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-b509acc3-64fc-4203-9a37-3f6997361e3a req-4c83dc92-c2b3-414d-b1fc-c18978e138ba service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] No waiting events found dispatching network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:44:11 user nova-compute[73067]: WARNING nova.compute.manager [req-b509acc3-64fc-4203-9a37-3f6997361e3a req-4c83dc92-c2b3-414d-b1fc-c18978e138ba service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received unexpected event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 for instance with vm_state building and task_state spawning.
Aug 16 10:44:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-521dfa2c-40ce-49bd-abe8-adaf2a8cd349 req-ff47f895-3411-4c47-b35a-d60a6eaed5e7 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-521dfa2c-40ce-49bd-abe8-adaf2a8cd349 req-ff47f895-3411-4c47-b35a-d60a6eaed5e7 service nova] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-521dfa2c-40ce-49bd-abe8-adaf2a8cd349 req-ff47f895-3411-4c47-b35a-d60a6eaed5e7 service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-521dfa2c-40ce-49bd-abe8-adaf2a8cd349 req-ff47f895-3411-4c47-b35a-d60a6eaed5e7 service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-521dfa2c-40ce-49bd-abe8-adaf2a8cd349 req-ff47f895-3411-4c47-b35a-d60a6eaed5e7 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] No waiting events found dispatching network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:44:13 user nova-compute[73067]: WARNING nova.compute.manager [req-521dfa2c-40ce-49bd-abe8-adaf2a8cd349 req-ff47f895-3411-4c47-b35a-d60a6eaed5e7 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received unexpected event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 for instance with vm_state building and task_state spawning.
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182653.6490042, 3d166e9d-e05d-4378-b14b-0c10318490b8 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:44:13 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] VM Resumed (Lifecycle Event)
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:44:13 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Instance spawned successfully.
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:44:13 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182653.6514587, 3d166e9d-e05d-4378-b14b-0c10318490b8 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:44:13 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] VM Started (Lifecycle Event)
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:44:13 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:44:13 user nova-compute[73067]: INFO nova.compute.manager [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Took 7.44 seconds to spawn the instance on the hypervisor.
Aug 16 10:44:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:44:13 user nova-compute[73067]: INFO nova.compute.manager [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Took 8.33 seconds to build instance.
Aug 16 10:44:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-556cb960-7f8e-4c0e-a4c0-2013f713da11 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.451s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:35 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:44:35 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:44:40 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:44:40 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7525MB free_disk=25.114673614501953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Applying migration context for instance 877d406e-ca6f-416f-a569-3cdc1ae545b2 as it has an incoming, in-progress migration 8482254a-f9aa-4602-988d-1587375801c1. Migration status is finished {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 10:44:40 user nova-compute[73067]: INFO nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating resource usage from migration 8482254a-f9aa-4602-988d-1587375801c1
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Migration 8482254a-f9aa-4602-988d-1587375801c1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 877d406e-ca6f-416f-a569-3cdc1ae545b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf85594-1255-4383-b359-17ee78c71c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 3d166e9d-e05d-4378-b14b-0c10318490b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:40 user nova-compute[73067]: INFO nova.compute.manager [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Terminating instance
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.manager [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-9ee05c4a-b028-4211-8ffd-5aacf530d0d7 req-0e582b37-997f-4e75-99ea-ffcf8a57604c service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received event network-vif-unplugged-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9ee05c4a-b028-4211-8ffd-5aacf530d0d7 req-0e582b37-997f-4e75-99ea-ffcf8a57604c service nova] Acquiring lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9ee05c4a-b028-4211-8ffd-5aacf530d0d7 req-0e582b37-997f-4e75-99ea-ffcf8a57604c service nova] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9ee05c4a-b028-4211-8ffd-5aacf530d0d7 req-0e582b37-997f-4e75-99ea-ffcf8a57604c service nova] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-9ee05c4a-b028-4211-8ffd-5aacf530d0d7 req-0e582b37-997f-4e75-99ea-ffcf8a57604c service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] No waiting events found dispatching network-vif-unplugged-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-9ee05c4a-b028-4211-8ffd-5aacf530d0d7 req-0e582b37-997f-4e75-99ea-ffcf8a57604c service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received event network-vif-unplugged-34d411e4-bda8-463e-9e31-a20a2510ab10 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Instance destroyed successfully.
Aug 16 10:44:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'resources' on Instance uuid 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1638794165',display_name='tempest-AttachVolumeNegativeTest-server-1638794165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1638794165',id=30,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjZ3PlNay1d9CmXhLq0+mHau1xgy9SQr4ruCDQWlsS5X44PHKvuPXXLHtX+4tXWmDME8M4Hu3BJ0brFN7gY7OmINqbm8PDEpwZJPzqIPqiWEhDHDsp4Eqwh5408hZuW9Q==',key_name='tempest-keypair-627036877',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:41:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-uwt0wxyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=5c7b9758-2f5f-4c06-b3af-5da0efcfb499,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "34d411e4-bda8-463e-9e31-a20a2510ab10", "address": "fa:16:3e:f2:8f:5b", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d411e4-bd", "ovs_interfaceid": "34d411e4-bda8-463e-9e31-a20a2510ab10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:8f:5b,bridge_name='br-int',has_traffic_filtering=True,id=34d411e4-bda8-463e-9e31-a20a2510ab10,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d411e4-bd') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG os_vif [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:8f:5b,bridge_name='br-int',has_traffic_filtering=True,id=34d411e4-bda8-463e-9e31-a20a2510ab10,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d411e4-bd') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34d411e4-bd, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:44:41 user nova-compute[73067]: INFO os_vif [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:8f:5b,bridge_name='br-int',has_traffic_filtering=True,id=34d411e4-bda8-463e-9e31-a20a2510ab10,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d411e4-bd')
Aug 16 10:44:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Deleting instance files /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499_del
Aug 16 10:44:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Deletion of /opt/stack/data/nova/instances/5c7b9758-2f5f-4c06-b3af-5da0efcfb499_del complete
Aug 16 10:44:41 user nova-compute[73067]: INFO nova.compute.manager [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 10:44:41 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:44:41 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:44:42 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:44:42 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Took 0.95 seconds to deallocate network for instance.
Aug 16 10:44:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:43 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Deleted allocations for instance 5c7b9758-2f5f-4c06-b3af-5da0efcfb499
Aug 16 10:44:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27e5cd2d-044f-40e0-81f8-ee5b673f965a tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.388s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-b91d6b6f-f183-447f-be8b-d9481adceadb req-1455d3fa-7c69-4cb8-8389-198954197868 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received event network-vif-plugged-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b91d6b6f-f183-447f-be8b-d9481adceadb req-1455d3fa-7c69-4cb8-8389-198954197868 service nova] Acquiring lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b91d6b6f-f183-447f-be8b-d9481adceadb req-1455d3fa-7c69-4cb8-8389-198954197868 service nova] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b91d6b6f-f183-447f-be8b-d9481adceadb req-1455d3fa-7c69-4cb8-8389-198954197868 service nova] Lock "5c7b9758-2f5f-4c06-b3af-5da0efcfb499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-b91d6b6f-f183-447f-be8b-d9481adceadb req-1455d3fa-7c69-4cb8-8389-198954197868 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] No waiting events found dispatching network-vif-plugged-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:44:43 user nova-compute[73067]: WARNING nova.compute.manager [req-b91d6b6f-f183-447f-be8b-d9481adceadb req-1455d3fa-7c69-4cb8-8389-198954197868 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received unexpected event network-vif-plugged-34d411e4-bda8-463e-9e31-a20a2510ab10 for instance with vm_state deleted and task_state None.
Aug 16 10:44:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-b91d6b6f-f183-447f-be8b-d9481adceadb req-1455d3fa-7c69-4cb8-8389-198954197868 service nova] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Received event network-vif-deleted-34d411e4-bda8-463e-9e31-a20a2510ab10 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:44:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updating instance_info_cache with network_info: [{"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:44:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:44:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:47 user nova-compute[73067]: INFO nova.compute.manager [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Terminating instance
Aug 16 10:44:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-4a5fd7c4-90eb-4b8a-b422-d1c30c05d772 req-e820ff94-4284-45b9-bd8a-a32d498b5906 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-vif-unplugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4a5fd7c4-90eb-4b8a-b422-d1c30c05d772 req-e820ff94-4284-45b9-bd8a-a32d498b5906 service nova] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4a5fd7c4-90eb-4b8a-b422-d1c30c05d772 req-e820ff94-4284-45b9-bd8a-a32d498b5906 service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4a5fd7c4-90eb-4b8a-b422-d1c30c05d772 req-e820ff94-4284-45b9-bd8a-a32d498b5906 service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-4a5fd7c4-90eb-4b8a-b422-d1c30c05d772 req-e820ff94-4284-45b9-bd8a-a32d498b5906 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] No waiting events found dispatching network-vif-unplugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:44:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-4a5fd7c4-90eb-4b8a-b422-d1c30c05d772 req-e820ff94-4284-45b9-bd8a-a32d498b5906 service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-vif-unplugged-9aec1f71-9229-4e37-b633-b2204d7a4484 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:44:48 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Instance destroyed successfully.
Aug 16 10:44:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'resources' on Instance uuid 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:44:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1846221895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1846221895',id=25,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQLeVJ9+VvVaQoNonbC1P2yB/UFcdPrlEtelI4nMnb6bicCGLgiVAtuSX8tNWkXxMJWyAVCENVhakwG4a4lJBnM4M+Mek/Dn7aiiBJzoKdLv41kQKbVz5WyipYM4S5xyQ==',key_name='tempest-keypair-917872012',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:42:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-hbj32uf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=4b3c2355-eee1-4a0f-bebc-9425ec85aac4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:44:48 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "9aec1f71-9229-4e37-b633-b2204d7a4484", "address": "fa:16:3e:41:d5:23", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aec1f71-92", "ovs_interfaceid": "9aec1f71-9229-4e37-b633-b2204d7a4484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:44:48 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:44:48 user nova-compute[73067]: DEBUG os_vif [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:44:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9aec1f71-92, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:44:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:48 user nova-compute[73067]: INFO os_vif [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d5:23,bridge_name='br-int',has_traffic_filtering=True,id=9aec1f71-9229-4e37-b633-b2204d7a4484,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aec1f71-92')
Aug 16 10:44:48 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Deleting instance files /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4_del
Aug 16 10:44:48 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Deletion of /opt/stack/data/nova/instances/4b3c2355-eee1-4a0f-bebc-9425ec85aac4_del complete
Aug 16 10:44:48 user nova-compute[73067]: INFO nova.compute.manager [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 10:44:48 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:44:48 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:44:48 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:44:49 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:44:49 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Took 1.00 seconds to deallocate network for instance.
Aug 16 10:44:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:49 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:44:49 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:44:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:49 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Deleted allocations for instance 4b3c2355-eee1-4a0f-bebc-9425ec85aac4
Aug 16 10:44:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9e89617-1bb9-4c98-9989-84e01100dc31 req-d6183dd6-2047-480d-b217-26955fb88eda service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:44:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9e89617-1bb9-4c98-9989-84e01100dc31 req-d6183dd6-2047-480d-b217-26955fb88eda service nova] Acquiring lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:44:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9e89617-1bb9-4c98-9989-84e01100dc31 req-d6183dd6-2047-480d-b217-26955fb88eda service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:44:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9e89617-1bb9-4c98-9989-84e01100dc31 req-d6183dd6-2047-480d-b217-26955fb88eda service nova] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9e89617-1bb9-4c98-9989-84e01100dc31 req-d6183dd6-2047-480d-b217-26955fb88eda service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] No waiting events found dispatching network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:44:49 user nova-compute[73067]: WARNING nova.compute.manager [req-d9e89617-1bb9-4c98-9989-84e01100dc31 req-d6183dd6-2047-480d-b217-26955fb88eda service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received unexpected event network-vif-plugged-9aec1f71-9229-4e37-b633-b2204d7a4484 for instance with vm_state deleted and task_state None.
Aug 16 10:44:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9e89617-1bb9-4c98-9989-84e01100dc31 req-d6183dd6-2047-480d-b217-26955fb88eda service nova] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Received event network-vif-deleted-9aec1f71-9229-4e37-b633-b2204d7a4484 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:44:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c26c9b-4a01-4bb9-b1b5-391d10b6fd73 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "4b3c2355-eee1-4a0f-bebc-9425ec85aac4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.504s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:44:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:56 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182681.6054306, 5c7b9758-2f5f-4c06-b3af-5da0efcfb499 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:44:56 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] VM Stopped (Lifecycle Event)
Aug 16 10:44:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9614b0cd-47ca-4507-ac83-b0c626d141ba None None] [instance: 5c7b9758-2f5f-4c06-b3af-5da0efcfb499] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:44:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:44:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:44:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:44:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:44:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:44:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:03 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182688.2596905, 4b3c2355-eee1-4a0f-bebc-9425ec85aac4 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:45:03 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] VM Stopped (Lifecycle Event)
Aug 16 10:45:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f960793e-c81e-4f20-94fa-5f6f49948bb1 None None] [instance: 4b3c2355-eee1-4a0f-bebc-9425ec85aac4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:45:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:45:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:45:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:45:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Going to confirm migration 1 {{(pid=73067) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 16 10:45:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:45:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquired lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:45:09 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:45:09 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'info_cache' on Instance uuid 877d406e-ca6f-416f-a569-3cdc1ae545b2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:45:10 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating instance_info_cache with network_info: [{"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:45:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Releasing lock "refresh_cache-877d406e-ca6f-416f-a569-3cdc1ae545b2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:45:10 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'migration_context' on Instance uuid 877d406e-ca6f-416f-a569-3cdc1ae545b2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:45:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:10 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:45:10 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:45:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.355s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:11 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Deleted allocation for migration 8482254a-f9aa-4602-988d-1587375801c1
Aug 16 10:45:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d915d98d-a04d-4cd6-9a19-c0f6dd2eb19e tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.542s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:13 user nova-compute[73067]: INFO nova.compute.manager [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] instance snapshotting
Aug 16 10:45:13 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Beginning live snapshot process
Aug 16 10:45:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json -f qcow2 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json -f qcow2 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5130j56e/8f184cf66e484ae7b2826e7cc7be75fb.delta 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:14 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5130j56e/8f184cf66e484ae7b2826e7cc7be75fb.delta 1073741824" returned: 0 in 0.145s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:14 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 10:45:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:45:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73067) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 10:45:15 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 10:45:16 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:45:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5130j56e/8f184cf66e484ae7b2826e7cc7be75fb.delta /opt/stack/data/nova/instances/snapshots/tmp5130j56e/8f184cf66e484ae7b2826e7cc7be75fb {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5130j56e/8f184cf66e484ae7b2826e7cc7be75fb.delta /opt/stack/data/nova/instances/snapshots/tmp5130j56e/8f184cf66e484ae7b2826e7cc7be75fb" returned: 0 in 0.568s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Snapshot extracted, beginning image upload
Aug 16 10:45:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:45:18 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Snapshot image upload complete
Aug 16 10:45:18 user nova-compute[73067]: INFO nova.compute.manager [None req-d341592d-790e-4d88-83f8-5b7e6f981215 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Took 5.07 seconds to snapshot the instance on the hypervisor.
Aug 16 10:45:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:45:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:45:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:45:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:45:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:45:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:28 user nova-compute[73067]: INFO nova.compute.manager [None req-04dc6a20-d71a-472a-adb9-dc72bb71720e tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Unrescuing
Aug 16 10:45:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-04dc6a20-d71a-472a-adb9-dc72bb71720e tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:45:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-04dc6a20-d71a-472a-adb9-dc72bb71720e tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquired lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:45:28 user nova-compute[73067]: DEBUG nova.network.neutron [None req-04dc6a20-d71a-472a-adb9-dc72bb71720e tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:45:28 user nova-compute[73067]: DEBUG nova.network.neutron [None req-04dc6a20-d71a-472a-adb9-dc72bb71720e tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updating instance_info_cache with network_info: [{"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:45:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-04dc6a20-d71a-472a-adb9-dc72bb71720e tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Releasing lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:45:28 user nova-compute[73067]: DEBUG nova.objects.instance [None req-04dc6a20-d71a-472a-adb9-dc72bb71720e tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'flavor' on Instance uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-a18fa312-4cab-4880-ab5e-e064abf20f79 req-39d8fdbb-acd9-4422-a8e2-9a57eeccf692 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a18fa312-4cab-4880-ab5e-e064abf20f79 req-39d8fdbb-acd9-4422-a8e2-9a57eeccf692 service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a18fa312-4cab-4880-ab5e-e064abf20f79 req-39d8fdbb-acd9-4422-a8e2-9a57eeccf692 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a18fa312-4cab-4880-ab5e-e064abf20f79 req-39d8fdbb-acd9-4422-a8e2-9a57eeccf692 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-a18fa312-4cab-4880-ab5e-e064abf20f79 req-39d8fdbb-acd9-4422-a8e2-9a57eeccf692 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:29 user nova-compute[73067]: WARNING nova.compute.manager [req-a18fa312-4cab-4880-ab5e-e064abf20f79 req-39d8fdbb-acd9-4422-a8e2-9a57eeccf692 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:45:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:29 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Instance destroyed successfully.
Aug 16 10:45:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d1cdc43a-6d6e-4994-bfee-8510db725de5 req-4016b5f6-6ffc-4aab-ae31-16973edc530f service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:45:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for 80c5b266-d257-447f-9c43-49e9a5455aef due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:45:32 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182732.9526324, 80c5b266-d257-447f-9c43-49e9a5455aef => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:45:32 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] VM Resumed (Lifecycle Event)
Aug 16 10:45:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-04dc6a20-d71a-472a-adb9-dc72bb71720e tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:45:33 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 10:45:33 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182732.953599, 80c5b266-d257-447f-9c43-49e9a5455aef => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:45:33 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] VM Started (Lifecycle Event)
Aug 16 10:45:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:45:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:45:34 user nova-compute[73067]: INFO nova.compute.claims [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Claim successful on node user
Aug 16 10:45:34 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:45:34 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:45:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:45:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG nova.policy [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be44e520761a493aab4b2a5973edd39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ce3a633ff54025aebcee0c30986ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:45:35 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Creating image(s)
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "/opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "/opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "/opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk 1073741824" returned: 0 in 0.054s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Successfully created port: 249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.211s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Cannot resize image /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:45:35 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'migration_context' on Instance uuid ada41106-bd49-4426-a12f-7033218ddb01 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Ensure instance console log exists: /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Successfully updated port: 249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "refresh_cache-ada41106-bd49-4426-a12f-7033218ddb01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquired lock "refresh_cache-ada41106-bd49-4426-a12f-7033218ddb01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-87c9a571-2e33-42c4-a94c-12291361bd52 req-dc2dc996-1528-4a91-a375-e1c8191cb525 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received event network-changed-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-87c9a571-2e33-42c4-a94c-12291361bd52 req-dc2dc996-1528-4a91-a375-e1c8191cb525 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Refreshing instance network info cache due to event network-changed-249ee321-c527-4e29-8b0a-4acf1ef9b611. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-87c9a571-2e33-42c4-a94c-12291361bd52 req-dc2dc996-1528-4a91-a375-e1c8191cb525 service nova] Acquiring lock "refresh_cache-ada41106-bd49-4426-a12f-7033218ddb01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Updating instance_info_cache with network_info: [{"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Releasing lock "refresh_cache-ada41106-bd49-4426-a12f-7033218ddb01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Instance network_info: |[{"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-87c9a571-2e33-42c4-a94c-12291361bd52 req-dc2dc996-1528-4a91-a375-e1c8191cb525 service nova] Acquired lock "refresh_cache-ada41106-bd49-4426-a12f-7033218ddb01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.network.neutron [req-87c9a571-2e33-42c4-a94c-12291361bd52 req-dc2dc996-1528-4a91-a375-e1c8191cb525 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Refreshing network info cache for port 249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Start _get_guest_xml network_info=[{"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:45:37 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:45:37 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1367568229',display_name='tempest-AttachVolumeNegativeTest-server-1367568229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1367568229',id=33,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwwQRWbf4hH7AJaH/37tv2wHN6qtOPePmiQmWLbz7FiXepbCkir150ycUSgULDs33TIGiKiwK+VqnALHsOCnrAF72qwNMjvnX8Oz9WL65TVPswlKKRxSkBlkfMTNAJiqA==',key_name='tempest-keypair-1859943190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-9e6gpgb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=ada41106-bd49-4426-a12f-7033218ddb01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=249ee321-c527-4e29-8b0a-4acf1ef9b611,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap249ee321-c5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'pci_devices' on Instance uuid ada41106-bd49-4426-a12f-7033218ddb01 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:45:37 user nova-compute[73067]:   <uuid>ada41106-bd49-4426-a12f-7033218ddb01</uuid>
Aug 16 10:45:37 user nova-compute[73067]:   <name>instance-00000021</name>
Aug 16 10:45:37 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:45:37 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:45:37 user nova-compute[73067]:   <metadata>
Aug 16 10:45:37 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:45:37 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:45:37 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1367568229</nova:name>
Aug 16 10:45:37 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:45:37</nova:creationTime>
Aug 16 10:45:37 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:45:37 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:45:37 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:45:37 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:45:37 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:45:37 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:45:37 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:45:37 user nova-compute[73067]:       <nova:owner>
Aug 16 10:45:37 user nova-compute[73067]:         <nova:user uuid="be44e520761a493aab4b2a5973edd39c">tempest-AttachVolumeNegativeTest-630141842-project-member</nova:user>
Aug 16 10:45:37 user nova-compute[73067]:         <nova:project uuid="52ce3a633ff54025aebcee0c30986ad9">tempest-AttachVolumeNegativeTest-630141842</nova:project>
Aug 16 10:45:37 user nova-compute[73067]:       </nova:owner>
Aug 16 10:45:37 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:45:37 user nova-compute[73067]:       <nova:ports>
Aug 16 10:45:37 user nova-compute[73067]:         <nova:port uuid="249ee321-c527-4e29-8b0a-4acf1ef9b611">
Aug 16 10:45:37 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 10:45:37 user nova-compute[73067]:         </nova:port>
Aug 16 10:45:37 user nova-compute[73067]:       </nova:ports>
Aug 16 10:45:37 user nova-compute[73067]:     </nova:instance>
Aug 16 10:45:37 user nova-compute[73067]:   </metadata>
Aug 16 10:45:37 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:45:37 user nova-compute[73067]:     <system>
Aug 16 10:45:37 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:45:37 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:45:37 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:45:37 user nova-compute[73067]:       <entry name="serial">ada41106-bd49-4426-a12f-7033218ddb01</entry>
Aug 16 10:45:37 user nova-compute[73067]:       <entry name="uuid">ada41106-bd49-4426-a12f-7033218ddb01</entry>
Aug 16 10:45:37 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:45:37 user nova-compute[73067]:     </system>
Aug 16 10:45:37 user nova-compute[73067]:   </sysinfo>
Aug 16 10:45:37 user nova-compute[73067]:   <os>
Aug 16 10:45:37 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:45:37 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:45:37 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:45:37 user nova-compute[73067]:   </os>
Aug 16 10:45:37 user nova-compute[73067]:   <features>
Aug 16 10:45:37 user nova-compute[73067]:     <acpi/>
Aug 16 10:45:37 user nova-compute[73067]:     <apic/>
Aug 16 10:45:37 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:45:37 user nova-compute[73067]:   </features>
Aug 16 10:45:37 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:45:37 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:45:37 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:45:37 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:45:37 user nova-compute[73067]:   </clock>
Aug 16 10:45:37 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:45:37 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:45:37 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:45:37 user nova-compute[73067]:   </cpu>
Aug 16 10:45:37 user nova-compute[73067]:   <devices>
Aug 16 10:45:37 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:45:37 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:45:37 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk"/>
Aug 16 10:45:37 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:45:37 user nova-compute[73067]:     </disk>
Aug 16 10:45:37 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:45:37 user nova-compute[73067]:       <mac address="fa:16:3e:18:eb:36"/>
Aug 16 10:45:37 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:45:37 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:45:37 user nova-compute[73067]:       <target dev="tap249ee321-c5"/>
Aug 16 10:45:37 user nova-compute[73067]:     </interface>
Aug 16 10:45:37 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:45:37 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/console.log" append="off"/>
Aug 16 10:45:37 user nova-compute[73067]:     </serial>
Aug 16 10:45:37 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:45:37 user nova-compute[73067]:     <video>
Aug 16 10:45:37 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:45:37 user nova-compute[73067]:     </video>
Aug 16 10:45:37 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:45:37 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:45:37 user nova-compute[73067]:     </rng>
Aug 16 10:45:37 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:45:37 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:45:37 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:45:37 user nova-compute[73067]:     </memballoon>
Aug 16 10:45:37 user nova-compute[73067]:   </devices>
Aug 16 10:45:37 user nova-compute[73067]: </domain>
Aug 16 10:45:37 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1367568229',display_name='tempest-AttachVolumeNegativeTest-server-1367568229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1367568229',id=33,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwwQRWbf4hH7AJaH/37tv2wHN6qtOPePmiQmWLbz7FiXepbCkir150ycUSgULDs33TIGiKiwK+VqnALHsOCnrAF72qwNMjvnX8Oz9WL65TVPswlKKRxSkBlkfMTNAJiqA==',key_name='tempest-keypair-1859943190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-9e6gpgb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=ada41106-bd49-4426-a12f-7033218ddb01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=249ee321-c527-4e29-8b0a-4acf1ef9b611,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap249ee321-c5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG os_vif [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=249ee321-c527-4e29-8b0a-4acf1ef9b611,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap249ee321-c5') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap249ee321-c5, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap249ee321-c5, col_values=(('external_ids', {'iface-id': '249ee321-c527-4e29-8b0a-4acf1ef9b611', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:eb:36', 'vm-uuid': 'ada41106-bd49-4426-a12f-7033218ddb01'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:37 user nova-compute[73067]: INFO os_vif [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=249ee321-c527-4e29-8b0a-4acf1ef9b611,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap249ee321-c5')
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No VIF found with MAC fa:16:3e:18:eb:36, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.network.neutron [req-87c9a571-2e33-42c4-a94c-12291361bd52 req-dc2dc996-1528-4a91-a375-e1c8191cb525 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Updated VIF entry in instance network info cache for port 249ee321-c527-4e29-8b0a-4acf1ef9b611. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG nova.network.neutron [req-87c9a571-2e33-42c4-a94c-12291361bd52 req-dc2dc996-1528-4a91-a375-e1c8191cb525 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Updating instance_info_cache with network_info: [{"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-87c9a571-2e33-42c4-a94c-12291361bd52 req-dc2dc996-1528-4a91-a375-e1c8191cb525 service nova] Releasing lock "refresh_cache-ada41106-bd49-4426-a12f-7033218ddb01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-43919173-138b-4b0d-9ca1-25ec7eaaf7df req-03ecef8a-67ec-4f44-ab7f-989cf94c85d4 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received event network-vif-plugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-43919173-138b-4b0d-9ca1-25ec7eaaf7df req-03ecef8a-67ec-4f44-ab7f-989cf94c85d4 service nova] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-43919173-138b-4b0d-9ca1-25ec7eaaf7df req-03ecef8a-67ec-4f44-ab7f-989cf94c85d4 service nova] Lock "ada41106-bd49-4426-a12f-7033218ddb01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-43919173-138b-4b0d-9ca1-25ec7eaaf7df req-03ecef8a-67ec-4f44-ab7f-989cf94c85d4 service nova] Lock "ada41106-bd49-4426-a12f-7033218ddb01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-43919173-138b-4b0d-9ca1-25ec7eaaf7df req-03ecef8a-67ec-4f44-ab7f-989cf94c85d4 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] No waiting events found dispatching network-vif-plugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:38 user nova-compute[73067]: WARNING nova.compute.manager [req-43919173-138b-4b0d-9ca1-25ec7eaaf7df req-03ecef8a-67ec-4f44-ab7f-989cf94c85d4 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received unexpected event network-vif-plugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 for instance with vm_state building and task_state spawning.
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182741.0782151, ada41106-bd49-4426-a12f-7033218ddb01 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:45:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ada41106-bd49-4426-a12f-7033218ddb01] VM Resumed (Lifecycle Event)
Aug 16 10:45:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-3037e270-71ac-4899-ab98-f9f802fb41c3 req-c07c80a2-3a53-4cf2-946e-d16c752cf331 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received event network-vif-plugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3037e270-71ac-4899-ab98-f9f802fb41c3 req-c07c80a2-3a53-4cf2-946e-d16c752cf331 service nova] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3037e270-71ac-4899-ab98-f9f802fb41c3 req-c07c80a2-3a53-4cf2-946e-d16c752cf331 service nova] Lock "ada41106-bd49-4426-a12f-7033218ddb01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3037e270-71ac-4899-ab98-f9f802fb41c3 req-c07c80a2-3a53-4cf2-946e-d16c752cf331 service nova] Lock "ada41106-bd49-4426-a12f-7033218ddb01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-3037e270-71ac-4899-ab98-f9f802fb41c3 req-c07c80a2-3a53-4cf2-946e-d16c752cf331 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] No waiting events found dispatching network-vif-plugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:41 user nova-compute[73067]: WARNING nova.compute.manager [req-3037e270-71ac-4899-ab98-f9f802fb41c3 req-c07c80a2-3a53-4cf2-946e-d16c752cf331 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received unexpected event network-vif-plugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 for instance with vm_state building and task_state spawning.
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:41 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:45:41 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7979MB free_disk=25.1181640625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Instance spawned successfully.
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "81148494-4e85-478e-b9d9-b7d2ec270083" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ada41106-bd49-4426-a12f-7033218ddb01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182741.0817916, ada41106-bd49-4426-a12f-7033218ddb01 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:45:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ada41106-bd49-4426-a12f-7033218ddb01] VM Started (Lifecycle Event)
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:45:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ada41106-bd49-4426-a12f-7033218ddb01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:45:41 user nova-compute[73067]: INFO nova.compute.manager [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Took 6.56 seconds to spawn the instance on the hypervisor.
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 877d406e-ca6f-416f-a569-3cdc1ae545b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf85594-1255-4383-b359-17ee78c71c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 3d166e9d-e05d-4378-b14b-0c10318490b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ada41106-bd49-4426-a12f-7033218ddb01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 81148494-4e85-478e-b9d9-b7d2ec270083 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:45:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:45:41 user nova-compute[73067]: INFO nova.compute.manager [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Took 7.32 seconds to build instance.
Aug 16 10:45:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f1d8c38e-4b5a-4a6e-be38-688386313619 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.432s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.431s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:45:42 user nova-compute[73067]: INFO nova.compute.claims [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Claim successful on node user
Aug 16 10:45:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:45:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:45:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Creating image(s)
Aug 16 10:45:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "/opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "/opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "/opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.policy [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '220084fddd114ff989a0603bdb98df76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1390d54176cf46679a1d44d85aa20ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk 1073741824" returned: 0 in 0.065s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Successfully created port: 2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Cannot resize image /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'migration_context' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Ensure instance console log exists: /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updating instance_info_cache with network_info: [{"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Successfully updated port: 2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquired lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-e4bb7dfc-e5f2-4486-96fd-98454f03890e req-c2becd62-0c83-4cfc-a743-fd45caa5efcf service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-changed-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-e4bb7dfc-e5f2-4486-96fd-98454f03890e req-c2becd62-0c83-4cfc-a743-fd45caa5efcf service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Refreshing instance network info cache due to event network-changed-2226e309-7e67-4ba4-a3df-27842a1bf141. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e4bb7dfc-e5f2-4486-96fd-98454f03890e req-c2becd62-0c83-4cfc-a743-fd45caa5efcf service nova] Acquiring lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updating instance_info_cache with network_info: [{"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Releasing lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Instance network_info: |[{"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e4bb7dfc-e5f2-4486-96fd-98454f03890e req-c2becd62-0c83-4cfc-a743-fd45caa5efcf service nova] Acquired lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.network.neutron [req-e4bb7dfc-e5f2-4486-96fd-98454f03890e req-c2becd62-0c83-4cfc-a743-fd45caa5efcf service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Refreshing network info cache for port 2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Start _get_guest_xml network_info=[{"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:45:44 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:45:44 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-940246306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-940246306',id=34,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+91O5aNF1XQEIRXWT/CgrWWVYkU+RRbBxeoeHT7AGdkueqb+uDUk5nYhmGOkaA44PbqOC8BjjrqE2LB8+Hi1KY6P78qtk10ejD3KJKkb4ub1VxWRGubVB8Tn/P0bqEWg==',key_name='tempest-keypair-2041136611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-6f92xc37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=81148494-4e85-478e-b9d9-b7d2ec270083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'pci_devices' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:45:44 user nova-compute[73067]:   <uuid>81148494-4e85-478e-b9d9-b7d2ec270083</uuid>
Aug 16 10:45:44 user nova-compute[73067]:   <name>instance-00000022</name>
Aug 16 10:45:44 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:45:44 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:45:44 user nova-compute[73067]:   <metadata>
Aug 16 10:45:44 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:45:44 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:45:44 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-940246306</nova:name>
Aug 16 10:45:44 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:45:44</nova:creationTime>
Aug 16 10:45:44 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:45:44 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:45:44 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:45:44 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:45:44 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:45:44 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:45:44 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:45:44 user nova-compute[73067]:       <nova:owner>
Aug 16 10:45:44 user nova-compute[73067]:         <nova:user uuid="220084fddd114ff989a0603bdb98df76">tempest-AttachVolumeShelveTestJSON-295458602-project-member</nova:user>
Aug 16 10:45:44 user nova-compute[73067]:         <nova:project uuid="1390d54176cf46679a1d44d85aa20ba0">tempest-AttachVolumeShelveTestJSON-295458602</nova:project>
Aug 16 10:45:44 user nova-compute[73067]:       </nova:owner>
Aug 16 10:45:44 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:45:44 user nova-compute[73067]:       <nova:ports>
Aug 16 10:45:44 user nova-compute[73067]:         <nova:port uuid="2226e309-7e67-4ba4-a3df-27842a1bf141">
Aug 16 10:45:44 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 10:45:44 user nova-compute[73067]:         </nova:port>
Aug 16 10:45:44 user nova-compute[73067]:       </nova:ports>
Aug 16 10:45:44 user nova-compute[73067]:     </nova:instance>
Aug 16 10:45:44 user nova-compute[73067]:   </metadata>
Aug 16 10:45:44 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:45:44 user nova-compute[73067]:     <system>
Aug 16 10:45:44 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:45:44 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:45:44 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:45:44 user nova-compute[73067]:       <entry name="serial">81148494-4e85-478e-b9d9-b7d2ec270083</entry>
Aug 16 10:45:44 user nova-compute[73067]:       <entry name="uuid">81148494-4e85-478e-b9d9-b7d2ec270083</entry>
Aug 16 10:45:44 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:45:44 user nova-compute[73067]:     </system>
Aug 16 10:45:44 user nova-compute[73067]:   </sysinfo>
Aug 16 10:45:44 user nova-compute[73067]:   <os>
Aug 16 10:45:44 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:45:44 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:45:44 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:45:44 user nova-compute[73067]:   </os>
Aug 16 10:45:44 user nova-compute[73067]:   <features>
Aug 16 10:45:44 user nova-compute[73067]:     <acpi/>
Aug 16 10:45:44 user nova-compute[73067]:     <apic/>
Aug 16 10:45:44 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:45:44 user nova-compute[73067]:   </features>
Aug 16 10:45:44 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:45:44 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:45:44 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:45:44 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:45:44 user nova-compute[73067]:   </clock>
Aug 16 10:45:44 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:45:44 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:45:44 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:45:44 user nova-compute[73067]:   </cpu>
Aug 16 10:45:44 user nova-compute[73067]:   <devices>
Aug 16 10:45:44 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:45:44 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:45:44 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk"/>
Aug 16 10:45:44 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:45:44 user nova-compute[73067]:     </disk>
Aug 16 10:45:44 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:45:44 user nova-compute[73067]:       <mac address="fa:16:3e:1b:0b:2e"/>
Aug 16 10:45:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:45:44 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:45:44 user nova-compute[73067]:       <target dev="tap2226e309-7e"/>
Aug 16 10:45:44 user nova-compute[73067]:     </interface>
Aug 16 10:45:44 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:45:44 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/console.log" append="off"/>
Aug 16 10:45:44 user nova-compute[73067]:     </serial>
Aug 16 10:45:44 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:45:44 user nova-compute[73067]:     <video>
Aug 16 10:45:44 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:45:44 user nova-compute[73067]:     </video>
Aug 16 10:45:44 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:45:44 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:45:44 user nova-compute[73067]:     </rng>
Aug 16 10:45:44 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:45:44 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:45:44 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:45:44 user nova-compute[73067]:     </memballoon>
Aug 16 10:45:44 user nova-compute[73067]:   </devices>
Aug 16 10:45:44 user nova-compute[73067]: </domain>
Aug 16 10:45:44 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-940246306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-940246306',id=34,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+91O5aNF1XQEIRXWT/CgrWWVYkU+RRbBxeoeHT7AGdkueqb+uDUk5nYhmGOkaA44PbqOC8BjjrqE2LB8+Hi1KY6P78qtk10ejD3KJKkb4ub1VxWRGubVB8Tn/P0bqEWg==',key_name='tempest-keypair-2041136611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-6f92xc37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=81148494-4e85-478e-b9d9-b7d2ec270083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG os_vif [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2226e309-7e, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2226e309-7e, col_values=(('external_ids', {'iface-id': '2226e309-7e67-4ba4-a3df-27842a1bf141', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:0b:2e', 'vm-uuid': '81148494-4e85-478e-b9d9-b7d2ec270083'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:45:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:45:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:45 user nova-compute[73067]: INFO os_vif [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e')
Aug 16 10:45:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:45:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] No VIF found with MAC fa:16:3e:1b:0b:2e, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:45:45 user nova-compute[73067]: DEBUG nova.network.neutron [req-e4bb7dfc-e5f2-4486-96fd-98454f03890e req-c2becd62-0c83-4cfc-a743-fd45caa5efcf service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updated VIF entry in instance network info cache for port 2226e309-7e67-4ba4-a3df-27842a1bf141. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:45:45 user nova-compute[73067]: DEBUG nova.network.neutron [req-e4bb7dfc-e5f2-4486-96fd-98454f03890e req-c2becd62-0c83-4cfc-a743-fd45caa5efcf service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updating instance_info_cache with network_info: [{"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:45:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e4bb7dfc-e5f2-4486-96fd-98454f03890e req-c2becd62-0c83-4cfc-a743-fd45caa5efcf service nova] Releasing lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:45:46 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:46 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:45:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-8edad245-171b-43f2-b765-a77a6118cc2e req-17d43c0d-71b2-463c-9235-b8e18f9218bd service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8edad245-171b-43f2-b765-a77a6118cc2e req-17d43c0d-71b2-463c-9235-b8e18f9218bd service nova] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8edad245-171b-43f2-b765-a77a6118cc2e req-17d43c0d-71b2-463c-9235-b8e18f9218bd service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8edad245-171b-43f2-b765-a77a6118cc2e req-17d43c0d-71b2-463c-9235-b8e18f9218bd service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-8edad245-171b-43f2-b765-a77a6118cc2e req-17d43c0d-71b2-463c-9235-b8e18f9218bd service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] No waiting events found dispatching network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:46 user nova-compute[73067]: WARNING nova.compute.manager [req-8edad245-171b-43f2-b765-a77a6118cc2e req-17d43c0d-71b2-463c-9235-b8e18f9218bd service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received unexpected event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 for instance with vm_state building and task_state spawning.
Aug 16 10:45:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182748.587362, 81148494-4e85-478e-b9d9-b7d2ec270083 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:45:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] VM Resumed (Lifecycle Event)
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:48 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Instance spawned successfully.
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:45:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182748.588685, 81148494-4e85-478e-b9d9-b7d2ec270083 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:45:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] VM Started (Lifecycle Event)
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:45:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:45:48 user nova-compute[73067]: INFO nova.compute.manager [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-e01b4be1-9131-45d1-9a66-3f37c61ff50d req-98fa276b-e53f-4891-9ba4-4e75e42ce935 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e01b4be1-9131-45d1-9a66-3f37c61ff50d req-98fa276b-e53f-4891-9ba4-4e75e42ce935 service nova] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e01b4be1-9131-45d1-9a66-3f37c61ff50d req-98fa276b-e53f-4891-9ba4-4e75e42ce935 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e01b4be1-9131-45d1-9a66-3f37c61ff50d req-98fa276b-e53f-4891-9ba4-4e75e42ce935 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-e01b4be1-9131-45d1-9a66-3f37c61ff50d req-98fa276b-e53f-4891-9ba4-4e75e42ce935 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] No waiting events found dispatching network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:45:48 user nova-compute[73067]: WARNING nova.compute.manager [req-e01b4be1-9131-45d1-9a66-3f37c61ff50d req-98fa276b-e53f-4891-9ba4-4e75e42ce935 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received unexpected event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 for instance with vm_state building and task_state spawning.
Aug 16 10:45:48 user nova-compute[73067]: INFO nova.compute.manager [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Took 7.07 seconds to build instance.
Aug 16 10:45:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f0772513-bb69-4c82-9da1-f5a679bc28eb tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "81148494-4e85-478e-b9d9-b7d2ec270083" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.232s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:45:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:45:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 10:45:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 10:45:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:45:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:01 user nova-compute[73067]: DEBUG nova.objects.instance [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'flavor' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:46:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:02 user nova-compute[73067]: INFO nova.compute.manager [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Attaching volume a9951460-1e67-4ccd-a087-485b9e28717b to /dev/vdb
Aug 16 10:46:02 user nova-compute[73067]: DEBUG os_brick.utils [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4761514-bdad-49a5-a2fa-f7fa2a139554]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c522ebc-ecde-412f-9cca-cf4267802168]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[66edc059-ff52-45eb-9ee7-4704622d7389]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[54280ee8-0107-491b-92b3-03045f40f114]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:46:02 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4f24fc-bef3-4f0c-9e09-9c7378d65286]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG os_brick.utils [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updating existing volume attachment record: 260ff4c0-d4c0-4a4d-a3f5-490c1e436fa2 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 311f3d35-c279-4b63-b3e1-7528c30ac659 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 57c883ce-680f-455e-b393-e8c82576d440 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 877d406e-ca6f-416f-a569-3cdc1ae545b2 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 4bf85594-1255-4383-b359-17ee78c71c6b {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid ada41106-bd49-4426-a12f-7033218ddb01 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "311f3d35-c279-4b63-b3e1-7528c30ac659" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "57c883ce-680f-455e-b393-e8c82576d440" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "80c5b266-d257-447f-9c43-49e9a5455aef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "4bf85594-1255-4383-b359-17ee78c71c6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "4bf85594-1255-4383-b359-17ee78c71c6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "ada41106-bd49-4426-a12f-7033218ddb01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "81148494-4e85-478e-b9d9-b7d2ec270083" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "57c883ce-680f-455e-b393-e8c82576d440" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "80c5b266-d257-447f-9c43-49e9a5455aef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "4bf85594-1255-4383-b359-17ee78c71c6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "ada41106-bd49-4426-a12f-7033218ddb01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "81148494-4e85-478e-b9d9-b7d2ec270083" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PVfkpKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:46:18 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:46:18 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:46:18 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d8b256-9aaf-470d-9246-a0201c13e586]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:46:18 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8114bf4f-e55e-4c3f-8824-e726d8eb4bd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b] added
Aug 16 10:46:18 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f6c8e2-ea16-4e7f-8aaa-af6ef05e9fa7]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e6ad3d-d940-41bb-be44-910fedb7c65c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PVfkpKRT {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PVfkpKRT" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5b2d8-942d-4648-b341-85af3fcda614]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PVfkpKRT'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b770d549-57da-416e-8e06-bcd05f24299f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6cae4e-cf82-42dc-9245-8832ed233bbf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:46:18 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:46:18 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:46:18 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:46:18 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bbc71a-3037-4718-aefb-978021c9b06c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260]
Aug 16 10:46:18 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260] successful.
Aug 16 10:46:18 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff952f5-8af4-4e4d-b570-21ca196c83c6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbeb7c5-498d-4bc3-900a-bd98d664e0e9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:46:18 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:46:18 user nova-compute[73067]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:46:18 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:46:18 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:46:18 user nova-compute[73067]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:46:18 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd7a320-078a-4717-b675-81cce97b268a]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:18 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:46:19 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:46:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PVfkpKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:46:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:46:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23262666238356233', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:46:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262666238356233', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:46:19 user nova-compute[73067]: DEBUG nova.objects.instance [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'flavor' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:46:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:46:19 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:46:19 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:46:19 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:46:19 user nova-compute[73067]:   <serial>a9951460-1e67-4ccd-a087-485b9e28717b</serial>
Aug 16 10:46:19 user nova-compute[73067]: </disk>
Aug 16 10:46:19 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:46:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:46:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:46:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] No VIF found with MAC fa:16:3e:88:b8:d4, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:46:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-44b5a9a7-d405-4cc3-9c50-a9aa4b5f6d1f tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.368s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.012s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-5f27b784-07a9-43ee-98de-002918099e07 req-4ad29446-b2a7-45fa-abeb-a8074e1c29b5 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-changed-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:46:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-5f27b784-07a9-43ee-98de-002918099e07 req-4ad29446-b2a7-45fa-abeb-a8074e1c29b5 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Refreshing instance network info cache due to event network-changed-22be01f1-3ab2-4867-a8f9-b1a050be6ff6. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:46:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5f27b784-07a9-43ee-98de-002918099e07 req-4ad29446-b2a7-45fa-abeb-a8074e1c29b5 service nova] Acquiring lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:46:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5f27b784-07a9-43ee-98de-002918099e07 req-4ad29446-b2a7-45fa-abeb-a8074e1c29b5 service nova] Acquired lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:46:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-5f27b784-07a9-43ee-98de-002918099e07 req-4ad29446-b2a7-45fa-abeb-a8074e1c29b5 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Refreshing network info cache for port 22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:46:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-5f27b784-07a9-43ee-98de-002918099e07 req-4ad29446-b2a7-45fa-abeb-a8074e1c29b5 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updated VIF entry in instance network info cache for port 22be01f1-3ab2-4867-a8f9-b1a050be6ff6. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:46:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-5f27b784-07a9-43ee-98de-002918099e07 req-4ad29446-b2a7-45fa-abeb-a8074e1c29b5 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updating instance_info_cache with network_info: [{"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:46:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5f27b784-07a9-43ee-98de-002918099e07 req-4ad29446-b2a7-45fa-abeb-a8074e1c29b5 service nova] Releasing lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:46:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-4768c89c-c906-4d4a-91b4-673ae7694f5e req-f39516dd-8fa1-4226-a971-2e03c1bbd9a0 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-changed-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:46:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-4768c89c-c906-4d4a-91b4-673ae7694f5e req-f39516dd-8fa1-4226-a971-2e03c1bbd9a0 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Refreshing instance network info cache due to event network-changed-22be01f1-3ab2-4867-a8f9-b1a050be6ff6. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:46:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4768c89c-c906-4d4a-91b4-673ae7694f5e req-f39516dd-8fa1-4226-a971-2e03c1bbd9a0 service nova] Acquiring lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:46:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4768c89c-c906-4d4a-91b4-673ae7694f5e req-f39516dd-8fa1-4226-a971-2e03c1bbd9a0 service nova] Acquired lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:46:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-4768c89c-c906-4d4a-91b4-673ae7694f5e req-f39516dd-8fa1-4226-a971-2e03c1bbd9a0 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Refreshing network info cache for port 22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:46:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-4768c89c-c906-4d4a-91b4-673ae7694f5e req-f39516dd-8fa1-4226-a971-2e03c1bbd9a0 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updated VIF entry in instance network info cache for port 22be01f1-3ab2-4867-a8f9-b1a050be6ff6. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:46:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-4768c89c-c906-4d4a-91b4-673ae7694f5e req-f39516dd-8fa1-4226-a971-2e03c1bbd9a0 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updating instance_info_cache with network_info: [{"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:46:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4768c89c-c906-4d4a-91b4-673ae7694f5e req-f39516dd-8fa1-4226-a971-2e03c1bbd9a0 service nova] Releasing lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:46:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:39 user nova-compute[73067]: INFO nova.compute.manager [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Rebooting instance
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquired lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:40 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:46:40 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7608MB free_disk=25.058727264404297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 877d406e-ca6f-416f-a569-3cdc1ae545b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf85594-1255-4383-b359-17ee78c71c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 3d166e9d-e05d-4378-b14b-0c10318490b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ada41106-bd49-4426-a12f-7033218ddb01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 81148494-4e85-478e-b9d9-b7d2ec270083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updating instance_info_cache with network_info: [{"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Releasing lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-bea0d777-58a0-49a2-b9e6-2c84abf354be req-dda64e78-4417-4b4c-bc48-14fa983aafea service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-vif-unplugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bea0d777-58a0-49a2-b9e6-2c84abf354be req-dda64e78-4417-4b4c-bc48-14fa983aafea service nova] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bea0d777-58a0-49a2-b9e6-2c84abf354be req-dda64e78-4417-4b4c-bc48-14fa983aafea service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bea0d777-58a0-49a2-b9e6-2c84abf354be req-dda64e78-4417-4b4c-bc48-14fa983aafea service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-bea0d777-58a0-49a2-b9e6-2c84abf354be req-dda64e78-4417-4b4c-bc48-14fa983aafea service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] No waiting events found dispatching network-vif-unplugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:46:40 user nova-compute[73067]: WARNING nova.compute.manager [req-bea0d777-58a0-49a2-b9e6-2c84abf354be req-dda64e78-4417-4b4c-bc48-14fa983aafea service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received unexpected event network-vif-unplugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 10:46:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:46:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.730s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Instance destroyed successfully.
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'resources' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1700906205',display_name='tempest-TestMinimumBasicScenario-server-1700906205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1700906205',id=32,image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgkiw20ibEVvyBP1aNII5Kpem4blK8hbWaXd0J7BdzDTr8pVYG1tDfn0jp74MsRSRZcBd+VsmMI/mvuaAIiw2eow7xaOLfJKpYvP+OZtSK6g70MwoLrjfNaYzUkMxS8FA==',key_name='tempest-TestMinimumBasicScenario-1462671997',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd5f36d1e3e24603bf6832c3b46a2942',ramdisk_id='',reservation_id='r-wrcz371w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1702842771',owner_user_name='tempest-TestMinimumBasicScenario-1702842771-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:46:40Z,user_data=None,user_id='61f8d65b293a41acb5aca991e2e41d57',uuid=3d166e9d-e05d-4378-b14b-0c10318490b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converting VIF {"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_vif [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22be01f1-3a, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:46:41 user nova-compute[73067]: INFO os_vif [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a')
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PVfkpKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:46:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[436fb96f-d1df-4673-b35b-7b11fd7fd8c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc3c2fa-ed98-4684-9534-819c5aea1570]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:46:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:46:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35841ccf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d42cc5-7398-4f9c-8528-9cec86d920a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d012e359-2b28-4480-b701-dc63b42d3c13]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[772e0a75-6591-4fa7-9a10-2f396207cab5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[789b4828-9748-46da-832b-aa644fdacb86]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[43845e88-af1b-43b1-b6b2-082e5e1f91ee]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8de904-5e80-4cd4-a288-4e9cf6380784]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260]
Aug 16 10:46:41 user nova-compute[73067]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260] successful.
Aug 16 10:46:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb761cb-ffa8-402a-b2bf-61977af29100]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] <== disconnect_volume: return (278ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Start _get_guest_xml network_info=[{"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a41081d-c9ae-4543-be55-100c2e2697d5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '4a41081d-c9ae-4543-be55-100c2e2697d5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PVfkpKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3d166e9d-e05d-4378-b14b-0c10318490b8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9951460-1e67-4ccd-a087-485b9e28717b', 'serial': 'a9951460-1e67-4ccd-a087-485b9e28717b'}, 'delete_on_termination': False, 'attachment_id': '260ff4c0-d4c0-4a4d-a3f5-490c1e436fa2', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:41 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:46:41 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a41081d-c9ae-4543-be55-100c2e2697d5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PVfkpKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:46:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:46:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:46:41 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b3e62e-0a84-4ffb-ad59-a9afd9ecc18f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:46:41 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfc7e01-edbf-44db-aabf-8c7927fdb19c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b] added
Aug 16 10:46:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[165099a2-3261-44f8-b41d-abbb486065c5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[508e7bfe-2651-4986-93ec-7b8ba4bb3aa3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PVfkpKRT {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PVfkpKRT" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[529148d1-3c47-46b4-b2e8-cd84a30c5eb9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PVfkpKRT'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[00edfcff-4b0a-402d-bf9b-2df618998e6d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[26133101-c633-4b59-a8d4-d2f2956d7c25]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2600981d-4655-4946-a39e-59fb5a5b90d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260]
Aug 16 10:46:41 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260] successful.
Aug 16 10:46:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b42dcd3-f711-45db-af55-ef24f5c03ff1]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2115a5-1a4f-45bb-ab8b-09485f50d6f2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:46:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:46:41 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:46:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:46:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0493f31-99a5-46a9-be39-d55dc8567e52]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PVfkpKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updating instance_info_cache with network_info: [{"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-2fffaaad-26f1-4ce9-8b9b-abd6c0336c5b req-134dbf72-69db-4995-9317-f18da547c66f service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2fffaaad-26f1-4ce9-8b9b-abd6c0336c5b req-134dbf72-69db-4995-9317-f18da547c66f service nova] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2fffaaad-26f1-4ce9-8b9b-abd6c0336c5b req-134dbf72-69db-4995-9317-f18da547c66f service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2fffaaad-26f1-4ce9-8b9b-abd6c0336c5b req-134dbf72-69db-4995-9317-f18da547c66f service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-2fffaaad-26f1-4ce9-8b9b-abd6c0336c5b req-134dbf72-69db-4995-9317-f18da547c66f service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] No waiting events found dispatching network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:46:42 user nova-compute[73067]: WARNING nova.compute.manager [req-2fffaaad-26f1-4ce9-8b9b-abd6c0336c5b req-134dbf72-69db-4995-9317-f18da547c66f service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received unexpected event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 10:46:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23262666238356233', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262666238356233', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1700906205',display_name='tempest-TestMinimumBasicScenario-server-1700906205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1700906205',id=32,image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgkiw20ibEVvyBP1aNII5Kpem4blK8hbWaXd0J7BdzDTr8pVYG1tDfn0jp74MsRSRZcBd+VsmMI/mvuaAIiw2eow7xaOLfJKpYvP+OZtSK6g70MwoLrjfNaYzUkMxS8FA==',key_name='tempest-TestMinimumBasicScenario-1462671997',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd5f36d1e3e24603bf6832c3b46a2942',ramdisk_id='',reservation_id='r-wrcz371w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1702842771',owner_user_name='tempest-TestMinimumBasicScenario-1702842771-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:46:40Z,user_data=None,user_id='61f8d65b293a41acb5aca991e2e41d57',uuid=3d166e9d-e05d-4378-b14b-0c10318490b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converting VIF {"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:46:43 user nova-compute[73067]:   <uuid>3d166e9d-e05d-4378-b14b-0c10318490b8</uuid>
Aug 16 10:46:43 user nova-compute[73067]:   <name>instance-00000020</name>
Aug 16 10:46:43 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:46:43 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:46:43 user nova-compute[73067]:   <metadata>
Aug 16 10:46:43 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:46:43 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:46:43 user nova-compute[73067]:       <nova:name>tempest-TestMinimumBasicScenario-server-1700906205</nova:name>
Aug 16 10:46:43 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:46:41</nova:creationTime>
Aug 16 10:46:43 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:46:43 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:46:43 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:46:43 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:46:43 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:46:43 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:46:43 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:46:43 user nova-compute[73067]:       <nova:owner>
Aug 16 10:46:43 user nova-compute[73067]:         <nova:user uuid="61f8d65b293a41acb5aca991e2e41d57">tempest-TestMinimumBasicScenario-1702842771-project-member</nova:user>
Aug 16 10:46:43 user nova-compute[73067]:         <nova:project uuid="fd5f36d1e3e24603bf6832c3b46a2942">tempest-TestMinimumBasicScenario-1702842771</nova:project>
Aug 16 10:46:43 user nova-compute[73067]:       </nova:owner>
Aug 16 10:46:43 user nova-compute[73067]:       <nova:root type="image" uuid="4a41081d-c9ae-4543-be55-100c2e2697d5"/>
Aug 16 10:46:43 user nova-compute[73067]:       <nova:ports>
Aug 16 10:46:43 user nova-compute[73067]:         <nova:port uuid="22be01f1-3ab2-4867-a8f9-b1a050be6ff6">
Aug 16 10:46:43 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 10:46:43 user nova-compute[73067]:         </nova:port>
Aug 16 10:46:43 user nova-compute[73067]:       </nova:ports>
Aug 16 10:46:43 user nova-compute[73067]:     </nova:instance>
Aug 16 10:46:43 user nova-compute[73067]:   </metadata>
Aug 16 10:46:43 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:46:43 user nova-compute[73067]:     <system>
Aug 16 10:46:43 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:46:43 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:46:43 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:46:43 user nova-compute[73067]:       <entry name="serial">3d166e9d-e05d-4378-b14b-0c10318490b8</entry>
Aug 16 10:46:43 user nova-compute[73067]:       <entry name="uuid">3d166e9d-e05d-4378-b14b-0c10318490b8</entry>
Aug 16 10:46:43 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:46:43 user nova-compute[73067]:     </system>
Aug 16 10:46:43 user nova-compute[73067]:   </sysinfo>
Aug 16 10:46:43 user nova-compute[73067]:   <os>
Aug 16 10:46:43 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:46:43 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:46:43 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:46:43 user nova-compute[73067]:   </os>
Aug 16 10:46:43 user nova-compute[73067]:   <features>
Aug 16 10:46:43 user nova-compute[73067]:     <acpi/>
Aug 16 10:46:43 user nova-compute[73067]:     <apic/>
Aug 16 10:46:43 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:46:43 user nova-compute[73067]:   </features>
Aug 16 10:46:43 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:46:43 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:46:43 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:46:43 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:46:43 user nova-compute[73067]:   </clock>
Aug 16 10:46:43 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:46:43 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:46:43 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:46:43 user nova-compute[73067]:   </cpu>
Aug 16 10:46:43 user nova-compute[73067]:   <devices>
Aug 16 10:46:43 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:46:43 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:46:43 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk"/>
Aug 16 10:46:43 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:46:43 user nova-compute[73067]:     </disk>
Aug 16 10:46:43 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:46:43 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:46:43 user nova-compute[73067]:       <source dev="/dev/sdc"/>
Aug 16 10:46:43 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:46:43 user nova-compute[73067]:       <serial>a9951460-1e67-4ccd-a087-485b9e28717b</serial>
Aug 16 10:46:43 user nova-compute[73067]:     </disk>
Aug 16 10:46:43 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:46:43 user nova-compute[73067]:       <mac address="fa:16:3e:88:b8:d4"/>
Aug 16 10:46:43 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:46:43 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:46:43 user nova-compute[73067]:       <target dev="tap22be01f1-3a"/>
Aug 16 10:46:43 user nova-compute[73067]:     </interface>
Aug 16 10:46:43 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:46:43 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/console.log" append="off"/>
Aug 16 10:46:43 user nova-compute[73067]:     </serial>
Aug 16 10:46:43 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:46:43 user nova-compute[73067]:     <video>
Aug 16 10:46:43 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:46:43 user nova-compute[73067]:     </video>
Aug 16 10:46:43 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:46:43 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:46:43 user nova-compute[73067]:     </rng>
Aug 16 10:46:43 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:46:43 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:46:43 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:46:43 user nova-compute[73067]:     </memballoon>
Aug 16 10:46:43 user nova-compute[73067]:   </devices>
Aug 16 10:46:43 user nova-compute[73067]: </domain>
Aug 16 10:46:43 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Cannot resize image /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'migration_context' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1700906205',display_name='tempest-TestMinimumBasicScenario-server-1700906205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1700906205',id=32,image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgkiw20ibEVvyBP1aNII5Kpem4blK8hbWaXd0J7BdzDTr8pVYG1tDfn0jp74MsRSRZcBd+VsmMI/mvuaAIiw2eow7xaOLfJKpYvP+OZtSK6g70MwoLrjfNaYzUkMxS8FA==',key_name='tempest-TestMinimumBasicScenario-1462671997',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='fd5f36d1e3e24603bf6832c3b46a2942',ramdisk_id='',reservation_id='r-wrcz371w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1702842771',owner_user_name='tempest-TestMinimumBasicScenario-1702842771-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:46:40Z,user_data=None,user_id='61f8d65b293a41acb5aca991e2e41d57',uuid=3d166e9d-e05d-4378-b14b-0c10318490b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converting VIF {"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG os_vif [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22be01f1-3a, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22be01f1-3a, col_values=(('external_ids', {'iface-id': '22be01f1-3ab2-4867-a8f9-b1a050be6ff6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:b8:d4', 'vm-uuid': '3d166e9d-e05d-4378-b14b-0c10318490b8'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:46:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:43 user nova-compute[73067]: INFO os_vif [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a')
Aug 16 10:46:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:46:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:46:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-21431ed9-50e3-4995-9728-9a09dc75730c req-effee50f-6891-4491-acbc-1320769c5d1f service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:46:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-21431ed9-50e3-4995-9728-9a09dc75730c req-effee50f-6891-4491-acbc-1320769c5d1f service nova] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-21431ed9-50e3-4995-9728-9a09dc75730c req-effee50f-6891-4491-acbc-1320769c5d1f service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-21431ed9-50e3-4995-9728-9a09dc75730c req-effee50f-6891-4491-acbc-1320769c5d1f service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-21431ed9-50e3-4995-9728-9a09dc75730c req-effee50f-6891-4491-acbc-1320769c5d1f service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] No waiting events found dispatching network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:46:45 user nova-compute[73067]: WARNING nova.compute.manager [req-21431ed9-50e3-4995-9728-9a09dc75730c req-effee50f-6891-4491-acbc-1320769c5d1f service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received unexpected event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 10:46:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for 3d166e9d-e05d-4378-b14b-0c10318490b8 due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182807.279296, 3d166e9d-e05d-4378-b14b-0c10318490b8 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:46:47 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] VM Resumed (Lifecycle Event)
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:46:47 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Instance rebooted successfully.
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:46:47 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182807.2809258, 3d166e9d-e05d-4378-b14b-0c10318490b8 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:46:47 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] VM Started (Lifecycle Event)
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9ec23efb-f0b8-495b-a639-875dfe897d01 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.345s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-3c607fa3-42bb-4395-8a38-39cdc2972212 req-a742f301-c816-46c9-8a05-87ed417ec6cd service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3c607fa3-42bb-4395-8a38-39cdc2972212 req-a742f301-c816-46c9-8a05-87ed417ec6cd service nova] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3c607fa3-42bb-4395-8a38-39cdc2972212 req-a742f301-c816-46c9-8a05-87ed417ec6cd service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3c607fa3-42bb-4395-8a38-39cdc2972212 req-a742f301-c816-46c9-8a05-87ed417ec6cd service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:46:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-3c607fa3-42bb-4395-8a38-39cdc2972212 req-a742f301-c816-46c9-8a05-87ed417ec6cd service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] No waiting events found dispatching network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:46:47 user nova-compute[73067]: WARNING nova.compute.manager [req-3c607fa3-42bb-4395-8a38-39cdc2972212 req-a742f301-c816-46c9-8a05-87ed417ec6cd service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received unexpected event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 for instance with vm_state active and task_state None.
Aug 16 10:46:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:46:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:00 user nova-compute[73067]: INFO nova.compute.manager [None req-918a0b33-87b5-4bdb-9848-149796ae01f3 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Get console output
Aug 16 10:47:00 user nova-compute[73067]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 16 10:47:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:47:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:10 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:47:10 user nova-compute[73067]: INFO nova.compute.claims [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Claim successful on node user
Aug 16 10:47:11 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:47:11 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:47:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:47:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:47:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:47:11 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:47:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:47:11 user nova-compute[73067]: INFO nova.virt.block_device [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Booting with volume-backed-image 8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58 at /dev/vda
Aug 16 10:47:11 user nova-compute[73067]: DEBUG nova.policy [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b135edcf064595b8d93052903696a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03e64450654fd693d6a1bd43017880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:47:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Successfully created port: 494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:47:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Successfully updated port: 494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:47:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:47:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquired lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:47:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:47:12 user nova-compute[73067]: DEBUG nova.compute.manager [req-830ed17d-e8de-41d9-be01-a1d248f815d9 req-082c4659-30ae-42b2-93c1-45c53318d484 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-changed-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:12 user nova-compute[73067]: DEBUG nova.compute.manager [req-830ed17d-e8de-41d9-be01-a1d248f815d9 req-082c4659-30ae-42b2-93c1-45c53318d484 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Refreshing instance network info cache due to event network-changed-494d5c6a-e5de-4fe9-b980-b0ac316cbb56. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:47:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-830ed17d-e8de-41d9-be01-a1d248f815d9 req-082c4659-30ae-42b2-93c1-45c53318d484 service nova] Acquiring lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:47:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:47:13 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Updating instance_info_cache with network_info: [{"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:47:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Releasing lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:47:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Instance network_info: |[{"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:47:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-830ed17d-e8de-41d9-be01-a1d248f815d9 req-082c4659-30ae-42b2-93c1-45c53318d484 service nova] Acquired lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:47:13 user nova-compute[73067]: DEBUG nova.network.neutron [req-830ed17d-e8de-41d9-be01-a1d248f815d9 req-082c4659-30ae-42b2-93c1-45c53318d484 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Refreshing network info cache for port 494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:47:13 user nova-compute[73067]: DEBUG nova.network.neutron [req-830ed17d-e8de-41d9-be01-a1d248f815d9 req-082c4659-30ae-42b2-93c1-45c53318d484 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Updated VIF entry in instance network info cache for port 494d5c6a-e5de-4fe9-b980-b0ac316cbb56. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:47:13 user nova-compute[73067]: DEBUG nova.network.neutron [req-830ed17d-e8de-41d9-be01-a1d248f815d9 req-082c4659-30ae-42b2-93c1-45c53318d484 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Updating instance_info_cache with network_info: [{"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:47:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-830ed17d-e8de-41d9-be01-a1d248f815d9 req-082c4659-30ae-42b2-93c1-45c53318d484 service nova] Releasing lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:47:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG os_brick.utils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2be3a5a-8185-4159-a726-1703c679cbec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[302ce76b-caf8-4e92-bd79-180d6bf380c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af27cf-0c10-4612-b318-7836ccd3c0bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[73819912-5e2d-4852-a003-04972e41161a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:47:22 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:47:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8f2346-3a73-4758-96f0-12b39e476d32]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG os_brick.utils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:47:22 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Updating existing volume attachment record: bd560867-9f57-4fc3-9a43-22ca7b9b4ec2 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:47:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:47:25 user nova-compute[73067]: INFO nova.compute.claims [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Claim successful on node user
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:47:25 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.policy [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '735a6aba3e974eb29e45ec3a7aa8c5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687a889259b948fa985ce7c9b84b030a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:47:25 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Creating image(s)
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-652dad75-518f-4b44-a3ab-abfe32cddeae req-4ae06547-e7f3-4d7c-be28-568d467e1db8 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received event network-changed-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-652dad75-518f-4b44-a3ab-abfe32cddeae req-4ae06547-e7f3-4d7c-be28-568d467e1db8 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Refreshing instance network info cache due to event network-changed-249ee321-c527-4e29-8b0a-4acf1ef9b611. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-652dad75-518f-4b44-a3ab-abfe32cddeae req-4ae06547-e7f3-4d7c-be28-568d467e1db8 service nova] Acquiring lock "refresh_cache-ada41106-bd49-4426-a12f-7033218ddb01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-652dad75-518f-4b44-a3ab-abfe32cddeae req-4ae06547-e7f3-4d7c-be28-568d467e1db8 service nova] Acquired lock "refresh_cache-ada41106-bd49-4426-a12f-7033218ddb01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG nova.network.neutron [req-652dad75-518f-4b44-a3ab-abfe32cddeae req-4ae06547-e7f3-4d7c-be28-568d467e1db8 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Refreshing network info cache for port 249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:47:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.206s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk 1073741824" returned: 0 in 0.052s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG nova.network.neutron [req-652dad75-518f-4b44-a3ab-abfe32cddeae req-4ae06547-e7f3-4d7c-be28-568d467e1db8 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Updated VIF entry in instance network info cache for port 249ee321-c527-4e29-8b0a-4acf1ef9b611. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG nova.network.neutron [req-652dad75-518f-4b44-a3ab-abfe32cddeae req-4ae06547-e7f3-4d7c-be28-568d467e1db8 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Updating instance_info_cache with network_info: [{"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-652dad75-518f-4b44-a3ab-abfe32cddeae req-4ae06547-e7f3-4d7c-be28-568d467e1db8 service nova] Releasing lock "refresh_cache-ada41106-bd49-4426-a12f-7033218ddb01" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Successfully created port: 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Cannot resize image /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'migration_context' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Ensure instance console log exists: /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Successfully updated port: 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquired lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating instance_info_cache with network_info: [{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Releasing lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Instance network_info: |[{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Start _get_guest_xml network_info=[{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:47:27 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:47:27 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1416483222',display_name='tempest-ServerRescueNegativeTestJSON-server-1416483222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1416483222',id=36,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZSCPday0zZtusc90U09XkPuUHqs59FJETrkx7ouQ6+KGHxRpdJeNn8QWjhp0Bkq7FUM8fcLwe989pfZZ9m2BSSvZLbH1uTcIOtXCCyMKKmSIV+hjUiqEXg2HrIkg3OoA==',key_name='tempest-keypair-1950898086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-0hu2g802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=58460bde-1b19-4ab9-b23a-5cae27a3b18b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:10:35,bridge_name='br-int',has_traffic_filtering=True,id=6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7f0f43-e4') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'pci_devices' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:47:27 user nova-compute[73067]:   <uuid>58460bde-1b19-4ab9-b23a-5cae27a3b18b</uuid>
Aug 16 10:47:27 user nova-compute[73067]:   <name>instance-00000024</name>
Aug 16 10:47:27 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:47:27 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:47:27 user nova-compute[73067]:   <metadata>
Aug 16 10:47:27 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:47:27 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:47:27 user nova-compute[73067]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1416483222</nova:name>
Aug 16 10:47:27 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:47:27</nova:creationTime>
Aug 16 10:47:27 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:47:27 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:47:27 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:47:27 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:47:27 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:47:27 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:47:27 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:47:27 user nova-compute[73067]:       <nova:owner>
Aug 16 10:47:27 user nova-compute[73067]:         <nova:user uuid="735a6aba3e974eb29e45ec3a7aa8c5cc">tempest-ServerRescueNegativeTestJSON-411494625-project-member</nova:user>
Aug 16 10:47:27 user nova-compute[73067]:         <nova:project uuid="687a889259b948fa985ce7c9b84b030a">tempest-ServerRescueNegativeTestJSON-411494625</nova:project>
Aug 16 10:47:27 user nova-compute[73067]:       </nova:owner>
Aug 16 10:47:27 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:47:27 user nova-compute[73067]:       <nova:ports>
Aug 16 10:47:27 user nova-compute[73067]:         <nova:port uuid="6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf">
Aug 16 10:47:27 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 10:47:27 user nova-compute[73067]:         </nova:port>
Aug 16 10:47:27 user nova-compute[73067]:       </nova:ports>
Aug 16 10:47:27 user nova-compute[73067]:     </nova:instance>
Aug 16 10:47:27 user nova-compute[73067]:   </metadata>
Aug 16 10:47:27 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:47:27 user nova-compute[73067]:     <system>
Aug 16 10:47:27 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:47:27 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:47:27 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:47:27 user nova-compute[73067]:       <entry name="serial">58460bde-1b19-4ab9-b23a-5cae27a3b18b</entry>
Aug 16 10:47:27 user nova-compute[73067]:       <entry name="uuid">58460bde-1b19-4ab9-b23a-5cae27a3b18b</entry>
Aug 16 10:47:27 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:47:27 user nova-compute[73067]:     </system>
Aug 16 10:47:27 user nova-compute[73067]:   </sysinfo>
Aug 16 10:47:27 user nova-compute[73067]:   <os>
Aug 16 10:47:27 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:47:27 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:47:27 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:47:27 user nova-compute[73067]:   </os>
Aug 16 10:47:27 user nova-compute[73067]:   <features>
Aug 16 10:47:27 user nova-compute[73067]:     <acpi/>
Aug 16 10:47:27 user nova-compute[73067]:     <apic/>
Aug 16 10:47:27 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:47:27 user nova-compute[73067]:   </features>
Aug 16 10:47:27 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:47:27 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:47:27 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:47:27 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:47:27 user nova-compute[73067]:   </clock>
Aug 16 10:47:27 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:47:27 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:47:27 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:47:27 user nova-compute[73067]:   </cpu>
Aug 16 10:47:27 user nova-compute[73067]:   <devices>
Aug 16 10:47:27 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:47:27 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:47:27 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk"/>
Aug 16 10:47:27 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:47:27 user nova-compute[73067]:     </disk>
Aug 16 10:47:27 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:47:27 user nova-compute[73067]:       <mac address="fa:16:3e:5e:10:35"/>
Aug 16 10:47:27 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:47:27 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:47:27 user nova-compute[73067]:       <target dev="tap6a7f0f43-e4"/>
Aug 16 10:47:27 user nova-compute[73067]:     </interface>
Aug 16 10:47:27 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:47:27 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/console.log" append="off"/>
Aug 16 10:47:27 user nova-compute[73067]:     </serial>
Aug 16 10:47:27 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:47:27 user nova-compute[73067]:     <video>
Aug 16 10:47:27 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:47:27 user nova-compute[73067]:     </video>
Aug 16 10:47:27 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:47:27 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:47:27 user nova-compute[73067]:     </rng>
Aug 16 10:47:27 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:47:27 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:47:27 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:47:27 user nova-compute[73067]:     </memballoon>
Aug 16 10:47:27 user nova-compute[73067]:   </devices>
Aug 16 10:47:27 user nova-compute[73067]: </domain>
Aug 16 10:47:27 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1416483222',display_name='tempest-ServerRescueNegativeTestJSON-server-1416483222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1416483222',id=36,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZSCPday0zZtusc90U09XkPuUHqs59FJETrkx7ouQ6+KGHxRpdJeNn8QWjhp0Bkq7FUM8fcLwe989pfZZ9m2BSSvZLbH1uTcIOtXCCyMKKmSIV+hjUiqEXg2HrIkg3OoA==',key_name='tempest-keypair-1950898086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-0hu2g802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=58460bde-1b19-4ab9-b23a-5cae27a3b18b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:10:35,bridge_name='br-int',has_traffic_filtering=True,id=6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7f0f43-e4') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG os_vif [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:10:35,bridge_name='br-int',has_traffic_filtering=True,id=6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7f0f43-e4') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a7f0f43-e4, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a7f0f43-e4, col_values=(('external_ids', {'iface-id': '6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:10:35', 'vm-uuid': '58460bde-1b19-4ab9-b23a-5cae27a3b18b'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:27 user nova-compute[73067]: INFO os_vif [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:10:35,bridge_name='br-int',has_traffic_filtering=True,id=6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7f0f43-e4')
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No VIF found with MAC fa:16:3e:5e:10:35, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-fd88743e-e61f-44d6-83d5-1304d02b1f51 req-6b69fe05-f371-4b62-a8bd-c75c9e8fe197 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-changed-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-fd88743e-e61f-44d6-83d5-1304d02b1f51 req-6b69fe05-f371-4b62-a8bd-c75c9e8fe197 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Refreshing instance network info cache due to event network-changed-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fd88743e-e61f-44d6-83d5-1304d02b1f51 req-6b69fe05-f371-4b62-a8bd-c75c9e8fe197 service nova] Acquiring lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fd88743e-e61f-44d6-83d5-1304d02b1f51 req-6b69fe05-f371-4b62-a8bd-c75c9e8fe197 service nova] Acquired lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:47:27 user nova-compute[73067]: DEBUG nova.network.neutron [req-fd88743e-e61f-44d6-83d5-1304d02b1f51 req-6b69fe05-f371-4b62-a8bd-c75c9e8fe197 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Refreshing network info cache for port 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:47:28 user nova-compute[73067]: DEBUG nova.network.neutron [req-fd88743e-e61f-44d6-83d5-1304d02b1f51 req-6b69fe05-f371-4b62-a8bd-c75c9e8fe197 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updated VIF entry in instance network info cache for port 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:47:28 user nova-compute[73067]: DEBUG nova.network.neutron [req-fd88743e-e61f-44d6-83d5-1304d02b1f51 req-6b69fe05-f371-4b62-a8bd-c75c9e8fe197 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating instance_info_cache with network_info: [{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:47:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fd88743e-e61f-44d6-83d5-1304d02b1f51 req-6b69fe05-f371-4b62-a8bd-c75c9e8fe197 service nova] Releasing lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:47:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-87e42690-fcab-4f8d-b830-6a9d3682a4da req-0b57471a-5653-485d-b3cd-32215f3922e2 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-87e42690-fcab-4f8d-b830-6a9d3682a4da req-0b57471a-5653-485d-b3cd-32215f3922e2 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-87e42690-fcab-4f8d-b830-6a9d3682a4da req-0b57471a-5653-485d-b3cd-32215f3922e2 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-87e42690-fcab-4f8d-b830-6a9d3682a4da req-0b57471a-5653-485d-b3cd-32215f3922e2 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-87e42690-fcab-4f8d-b830-6a9d3682a4da req-0b57471a-5653-485d-b3cd-32215f3922e2 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:47:29 user nova-compute[73067]: WARNING nova.compute.manager [req-87e42690-fcab-4f8d-b830-6a9d3682a4da req-0b57471a-5653-485d-b3cd-32215f3922e2 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state building and task_state spawning.
Aug 16 10:47:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182851.2654018, 58460bde-1b19-4ab9-b23a-5cae27a3b18b => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:47:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] VM Resumed (Lifecycle Event)
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:47:31 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Instance spawned successfully.
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182851.2667584, 58460bde-1b19-4ab9-b23a-5cae27a3b18b => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:47:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] VM Started (Lifecycle Event)
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d37fd3e6-6ce9-42b3-8f40-892db08ea1ea req-3dde89fb-052f-45fd-bb19-8b1bd2561534 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d37fd3e6-6ce9-42b3-8f40-892db08ea1ea req-3dde89fb-052f-45fd-bb19-8b1bd2561534 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d37fd3e6-6ce9-42b3-8f40-892db08ea1ea req-3dde89fb-052f-45fd-bb19-8b1bd2561534 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d37fd3e6-6ce9-42b3-8f40-892db08ea1ea req-3dde89fb-052f-45fd-bb19-8b1bd2561534 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d37fd3e6-6ce9-42b3-8f40-892db08ea1ea req-3dde89fb-052f-45fd-bb19-8b1bd2561534 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:47:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d37fd3e6-6ce9-42b3-8f40-892db08ea1ea req-3dde89fb-052f-45fd-bb19-8b1bd2561534 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state building and task_state spawning.
Aug 16 10:47:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:47:31 user nova-compute[73067]: INFO nova.compute.manager [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Took 5.52 seconds to spawn the instance on the hypervisor.
Aug 16 10:47:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:47:31 user nova-compute[73067]: INFO nova.compute.manager [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Took 6.35 seconds to build instance.
Aug 16 10:47:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d02d9c5e-6a2c-4dbc-93ad-f4dff1a61fd7 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.441s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-ebf0ff1c-b120-488d-9689-4bef3256ac48 req-bb9be17b-25cd-4bdf-92d8-29a68a6fdfd8 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-changed-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-ebf0ff1c-b120-488d-9689-4bef3256ac48 req-bb9be17b-25cd-4bdf-92d8-29a68a6fdfd8 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Refreshing instance network info cache due to event network-changed-2226e309-7e67-4ba4-a3df-27842a1bf141. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:47:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ebf0ff1c-b120-488d-9689-4bef3256ac48 req-bb9be17b-25cd-4bdf-92d8-29a68a6fdfd8 service nova] Acquiring lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:47:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ebf0ff1c-b120-488d-9689-4bef3256ac48 req-bb9be17b-25cd-4bdf-92d8-29a68a6fdfd8 service nova] Acquired lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:47:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-ebf0ff1c-b120-488d-9689-4bef3256ac48 req-bb9be17b-25cd-4bdf-92d8-29a68a6fdfd8 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Refreshing network info cache for port 2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:47:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-ebf0ff1c-b120-488d-9689-4bef3256ac48 req-bb9be17b-25cd-4bdf-92d8-29a68a6fdfd8 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updated VIF entry in instance network info cache for port 2226e309-7e67-4ba4-a3df-27842a1bf141. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:47:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-ebf0ff1c-b120-488d-9689-4bef3256ac48 req-bb9be17b-25cd-4bdf-92d8-29a68a6fdfd8 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updating instance_info_cache with network_info: [{"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:47:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ebf0ff1c-b120-488d-9689-4bef3256ac48 req-bb9be17b-25cd-4bdf-92d8-29a68a6fdfd8 service nova] Releasing lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.objects.instance [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'flavor' on Instance uuid ada41106-bd49-4426-a12f-7033218ddb01 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:47:36 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Creating image(s)
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Ensure instance console log exists: /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Start _get_guest_xml network_info=[{"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhWvyqYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd2f9cf3-f43d-40db-ada8-79c50589b1b8', 'attached_at': '', 'detached_at': '', 'volume_id': '921d230b-3591-4cb2-b81a-b4988d120cba', 'serial': '921d230b-3591-4cb2-b81a-b4988d120cba'}, 'delete_on_termination': False, 'attachment_id': 'bd560867-9f57-4fc3-9a43-22ca7b9b4ec2', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:47:36 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:47:36 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhWvyqYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:47:36 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:47:36 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:47:36 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[827e3137-bcf5-4aa7-bab7-0e4eeb36127a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:47:36 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:36 user nova-compute[73067]: INFO nova.compute.manager [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Attaching volume d3eb6153-08c8-4a9c-ba3f-186168ee36f2 to /dev/vdb
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a0f84-95de-4b96-9fa4-16e66c345e36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba] added
Aug 16 10:47:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0e8ed6-55ea-4aa4-996a-75eb69ee939f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc9e50-e21b-4485-aed2-ae91399e4246]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhWvyqYZ {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhWvyqYZ" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ae07f-d03d-4134-a2e2-8e8411ff695c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UhWvyqYZ'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.utils [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aef026-9634-419b-9576-ec231b31c109]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e90593-4b7e-447e-a240-1c888c8e2849]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd5455f-2cfe-4354-a31f-b53c89607900]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:47:36 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:47:36 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:47:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:47:36 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:47:36 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:47:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[76688828-cf6c-4843-bb48-b421150f183f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd6147d-206d-43e6-a7ce-75772dcb1234]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3178db-2410-45bd-8808-4b5f785ac783]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abd8a9b-3613-46cf-a4e5-96c389842b8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba, portal: 172.16.0.220,3260]
Aug 16 10:47:36 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba, portal: 172.16.0.220,3260] successful.
Aug 16 10:47:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:47:36 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2353f36-dbbc-43ba-94db-cd6834ceed90]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.utils [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Updating existing volume attachment record: e27deb64-a1e3-4e05-b43b-75db81af8d31 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ad9409-38ac-4d3b-a0ec-2533195e65dd]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3a1a8f-fad1-4d3c-a005-a1c8aea41bbd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:47:36 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:47:36 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:47:36 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:47:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:47:36 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:47:36 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:47:36 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:47:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd72bdee-faaa-437d-8ed4-8d8aabd53c3f]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhWvyqYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:47:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "81148494-4e85-478e-b9d9-b7d2ec270083" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:37 user nova-compute[73067]: INFO nova.compute.manager [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Shelving
Aug 16 10:47:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23361663735666463', 'path': '/dev/sdd'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361663735666463', 'path': '/dev/sdd'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-346489190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-346489190',id=35,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-mjml73w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:47:11Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=cd2f9cf3-f43d-40db-ada8-79c50589b1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:de:d4,bridge_name='br-int',has_traffic_filtering=True,id=494d5c6a-e5de-4fe9-b980-b0ac316cbb56,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d5c6a-e5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'pci_devices' on Instance uuid cd2f9cf3-f43d-40db-ada8-79c50589b1b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:47:37 user nova-compute[73067]:   <uuid>cd2f9cf3-f43d-40db-ada8-79c50589b1b8</uuid>
Aug 16 10:47:37 user nova-compute[73067]:   <name>instance-00000023</name>
Aug 16 10:47:37 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:47:37 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:47:37 user nova-compute[73067]:   <metadata>
Aug 16 10:47:37 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:47:37 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:47:37 user nova-compute[73067]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-346489190</nova:name>
Aug 16 10:47:37 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:47:36</nova:creationTime>
Aug 16 10:47:37 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:47:37 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:47:37 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:47:37 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:47:37 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:47:37 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:47:37 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:47:37 user nova-compute[73067]:       <nova:owner>
Aug 16 10:47:37 user nova-compute[73067]:         <nova:user uuid="d3b135edcf064595b8d93052903696a7">tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member</nova:user>
Aug 16 10:47:37 user nova-compute[73067]:         <nova:project uuid="4d03e64450654fd693d6a1bd43017880">tempest-ServerBootFromVolumeStableRescueTest-1973630968</nova:project>
Aug 16 10:47:37 user nova-compute[73067]:       </nova:owner>
Aug 16 10:47:37 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:47:37 user nova-compute[73067]:       <nova:ports>
Aug 16 10:47:37 user nova-compute[73067]:         <nova:port uuid="494d5c6a-e5de-4fe9-b980-b0ac316cbb56">
Aug 16 10:47:37 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 10:47:37 user nova-compute[73067]:         </nova:port>
Aug 16 10:47:37 user nova-compute[73067]:       </nova:ports>
Aug 16 10:47:37 user nova-compute[73067]:     </nova:instance>
Aug 16 10:47:37 user nova-compute[73067]:   </metadata>
Aug 16 10:47:37 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:47:37 user nova-compute[73067]:     <system>
Aug 16 10:47:37 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:47:37 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:47:37 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:47:37 user nova-compute[73067]:       <entry name="serial">cd2f9cf3-f43d-40db-ada8-79c50589b1b8</entry>
Aug 16 10:47:37 user nova-compute[73067]:       <entry name="uuid">cd2f9cf3-f43d-40db-ada8-79c50589b1b8</entry>
Aug 16 10:47:37 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:47:37 user nova-compute[73067]:     </system>
Aug 16 10:47:37 user nova-compute[73067]:   </sysinfo>
Aug 16 10:47:37 user nova-compute[73067]:   <os>
Aug 16 10:47:37 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:47:37 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:47:37 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:47:37 user nova-compute[73067]:   </os>
Aug 16 10:47:37 user nova-compute[73067]:   <features>
Aug 16 10:47:37 user nova-compute[73067]:     <acpi/>
Aug 16 10:47:37 user nova-compute[73067]:     <apic/>
Aug 16 10:47:37 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:47:37 user nova-compute[73067]:   </features>
Aug 16 10:47:37 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:47:37 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:47:37 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:47:37 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:47:37 user nova-compute[73067]:   </clock>
Aug 16 10:47:37 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:47:37 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:47:37 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:47:37 user nova-compute[73067]:   </cpu>
Aug 16 10:47:37 user nova-compute[73067]:   <devices>
Aug 16 10:47:37 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:47:37 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:47:37 user nova-compute[73067]:       <source dev="/dev/sdd"/>
Aug 16 10:47:37 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:47:37 user nova-compute[73067]:       <serial>921d230b-3591-4cb2-b81a-b4988d120cba</serial>
Aug 16 10:47:37 user nova-compute[73067]:     </disk>
Aug 16 10:47:37 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:47:37 user nova-compute[73067]:       <mac address="fa:16:3e:22:de:d4"/>
Aug 16 10:47:37 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:47:37 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:47:37 user nova-compute[73067]:       <target dev="tap494d5c6a-e5"/>
Aug 16 10:47:37 user nova-compute[73067]:     </interface>
Aug 16 10:47:37 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:47:37 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/console.log" append="off"/>
Aug 16 10:47:37 user nova-compute[73067]:     </serial>
Aug 16 10:47:37 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:47:37 user nova-compute[73067]:     <video>
Aug 16 10:47:37 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:47:37 user nova-compute[73067]:     </video>
Aug 16 10:47:37 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:47:37 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:47:37 user nova-compute[73067]:     </rng>
Aug 16 10:47:37 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:47:37 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:47:37 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:47:37 user nova-compute[73067]:     </memballoon>
Aug 16 10:47:37 user nova-compute[73067]:   </devices>
Aug 16 10:47:37 user nova-compute[73067]: </domain>
Aug 16 10:47:37 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-346489190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-346489190',id=35,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-mjml73w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:47:11Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=cd2f9cf3-f43d-40db-ada8-79c50589b1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:de:d4,bridge_name='br-int',has_traffic_filtering=True,id=494d5c6a-e5de-4fe9-b980-b0ac316cbb56,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d5c6a-e5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG os_vif [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:de:d4,bridge_name='br-int',has_traffic_filtering=True,id=494d5c6a-e5de-4fe9-b980-b0ac316cbb56,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d5c6a-e5') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap494d5c6a-e5, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap494d5c6a-e5, col_values=(('external_ids', {'iface-id': '494d5c6a-e5de-4fe9-b980-b0ac316cbb56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:de:d4', 'vm-uuid': 'cd2f9cf3-f43d-40db-ada8-79c50589b1b8'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:37 user nova-compute[73067]: INFO os_vif [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:de:d4,bridge_name='br-int',has_traffic_filtering=True,id=494d5c6a-e5de-4fe9-b980-b0ac316cbb56,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d5c6a-e5')
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No VIF found with MAC fa:16:3e:22:de:d4, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-d305a0f2-b57b-490e-abf7-1de461e1e20a req-ae59ba3e-d1bb-4de0-a4f0-7f7d3ccae5d9 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-vif-unplugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d305a0f2-b57b-490e-abf7-1de461e1e20a req-ae59ba3e-d1bb-4de0-a4f0-7f7d3ccae5d9 service nova] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d305a0f2-b57b-490e-abf7-1de461e1e20a req-ae59ba3e-d1bb-4de0-a4f0-7f7d3ccae5d9 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d305a0f2-b57b-490e-abf7-1de461e1e20a req-ae59ba3e-d1bb-4de0-a4f0-7f7d3ccae5d9 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-d305a0f2-b57b-490e-abf7-1de461e1e20a req-ae59ba3e-d1bb-4de0-a4f0-7f7d3ccae5d9 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] No waiting events found dispatching network-vif-unplugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:47:37 user nova-compute[73067]: WARNING nova.compute.manager [req-d305a0f2-b57b-490e-abf7-1de461e1e20a req-ae59ba3e-d1bb-4de0-a4f0-7f7d3ccae5d9 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received unexpected event network-vif-unplugged-2226e309-7e67-4ba4-a3df-27842a1bf141 for instance with vm_state active and task_state shelving.
Aug 16 10:47:38 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:47:38 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:47:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:38 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:47:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Instance destroyed successfully.
Aug 16 10:47:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Beginning cold snapshot process
Aug 16 10:47:39 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:47:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk /opt/stack/data/nova/instances/snapshots/tmpzp4wfryj/36a6b8015f124c1aaa03a5248a20a6e9 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-c8bda89d-752f-44cc-a6f0-4938d22de0ac req-f98db6cd-1004-49a9-a6ea-231b7ea72b37 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c8bda89d-752f-44cc-a6f0-4938d22de0ac req-f98db6cd-1004-49a9-a6ea-231b7ea72b37 service nova] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c8bda89d-752f-44cc-a6f0-4938d22de0ac req-f98db6cd-1004-49a9-a6ea-231b7ea72b37 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c8bda89d-752f-44cc-a6f0-4938d22de0ac req-f98db6cd-1004-49a9-a6ea-231b7ea72b37 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-c8bda89d-752f-44cc-a6f0-4938d22de0ac req-f98db6cd-1004-49a9-a6ea-231b7ea72b37 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] No waiting events found dispatching network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:47:40 user nova-compute[73067]: WARNING nova.compute.manager [req-c8bda89d-752f-44cc-a6f0-4938d22de0ac req-f98db6cd-1004-49a9-a6ea-231b7ea72b37 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received unexpected event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk /opt/stack/data/nova/instances/snapshots/tmpzp4wfryj/36a6b8015f124c1aaa03a5248a20a6e9" returned: 0 in 0.700s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:40 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Snapshot extracted, beginning image upload
Aug 16 10:47:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-d84ab04a-2084-45bd-a8c8-e7300273695b req-b8fdb95b-b8e5-4455-8ce4-bb5170f0f6cb service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d84ab04a-2084-45bd-a8c8-e7300273695b req-b8fdb95b-b8e5-4455-8ce4-bb5170f0f6cb service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d84ab04a-2084-45bd-a8c8-e7300273695b req-b8fdb95b-b8e5-4455-8ce4-bb5170f0f6cb service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d84ab04a-2084-45bd-a8c8-e7300273695b req-b8fdb95b-b8e5-4455-8ce4-bb5170f0f6cb service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-d84ab04a-2084-45bd-a8c8-e7300273695b req-b8fdb95b-b8e5-4455-8ce4-bb5170f0f6cb service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:47:40 user nova-compute[73067]: WARNING nova.compute.manager [req-d84ab04a-2084-45bd-a8c8-e7300273695b req-b8fdb95b-b8e5-4455-8ce4-bb5170f0f6cb service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state building and task_state spawning.
Aug 16 10:47:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182862.0584188, cd2f9cf3-f43d-40db-ada8-79c50589b1b8 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:47:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] VM Resumed (Lifecycle Event)
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:47:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Instance spawned successfully.
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:47:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182862.0588214, cd2f9cf3-f43d-40db-ada8-79c50589b1b8 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:47:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] VM Started (Lifecycle Event)
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:42 user nova-compute[73067]: INFO nova.compute.manager [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-4f7e5690-316a-4431-92cb-0cf1334879cc req-fc22454e-2f78-40e8-9b31-91ccaf4935d9 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4f7e5690-316a-4431-92cb-0cf1334879cc req-fc22454e-2f78-40e8-9b31-91ccaf4935d9 service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4f7e5690-316a-4431-92cb-0cf1334879cc req-fc22454e-2f78-40e8-9b31-91ccaf4935d9 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4f7e5690-316a-4431-92cb-0cf1334879cc req-fc22454e-2f78-40e8-9b31-91ccaf4935d9 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-4f7e5690-316a-4431-92cb-0cf1334879cc req-fc22454e-2f78-40e8-9b31-91ccaf4935d9 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:47:42 user nova-compute[73067]: WARNING nova.compute.manager [req-4f7e5690-316a-4431-92cb-0cf1334879cc req-fc22454e-2f78-40e8-9b31-91ccaf4935d9 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state building and task_state spawning.
Aug 16 10:47:42 user nova-compute[73067]: INFO nova.compute.manager [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Took 31.59 seconds to build instance.
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e9b27496-b4ab-4e97-af9c-a8682d307bec tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.726s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Snapshot image upload complete
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:42 user nova-compute[73067]: INFO nova.compute.manager [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Shelve offloading
Aug 16 10:47:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Instance destroyed successfully.
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquired lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG nova.network.neutron [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updating instance_info_cache with network_info: [{"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Releasing lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Instance destroyed successfully.
Aug 16 10:47:44 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'resources' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-940246306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-940246306',id=34,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+91O5aNF1XQEIRXWT/CgrWWVYkU+RRbBxeoeHT7AGdkueqb+uDUk5nYhmGOkaA44PbqOC8BjjrqE2LB8+Hi1KY6P78qtk10ejD3KJKkb4ub1VxWRGubVB8Tn/P0bqEWg==',key_name='tempest-keypair-2041136611',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:45:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-6f92xc37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member',shelved_at='2023-08-16T10:47:42.699499',shelved_host='user',shelved_image_id='495cc8b2-8342-4138-99ce-ae78a9778aeb'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=81148494-4e85-478e-b9d9-b7d2ec270083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG os_vif [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2226e309-7e, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:47:44 user nova-compute[73067]: INFO os_vif [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e')
Aug 16 10:47:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Deleting instance files /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083_del
Aug 16 10:47:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Deletion of /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083_del complete
Aug 16 10:47:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-43890da9-108e-4594-aa3e-2fba274125c8 req-2497aff3-b371-4c46-ad21-866c4b70a7b3 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-changed-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-43890da9-108e-4594-aa3e-2fba274125c8 req-2497aff3-b371-4c46-ad21-866c4b70a7b3 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Refreshing instance network info cache due to event network-changed-2226e309-7e67-4ba4-a3df-27842a1bf141. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-43890da9-108e-4594-aa3e-2fba274125c8 req-2497aff3-b371-4c46-ad21-866c4b70a7b3 service nova] Acquiring lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-43890da9-108e-4594-aa3e-2fba274125c8 req-2497aff3-b371-4c46-ad21-866c4b70a7b3 service nova] Acquired lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG nova.network.neutron [req-43890da9-108e-4594-aa3e-2fba274125c8 req-2497aff3-b371-4c46-ad21-866c4b70a7b3 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Refreshing network info cache for port 2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:44 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Deleted allocations for instance 81148494-4e85-478e-b9d9-b7d2ec270083
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'numa_topology' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:47:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:45 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:47:45 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7600MB free_disk=25.04682159423828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.network.neutron [req-43890da9-108e-4594-aa3e-2fba274125c8 req-2497aff3-b371-4c46-ad21-866c4b70a7b3 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updated VIF entry in instance network info cache for port 2226e309-7e67-4ba4-a3df-27842a1bf141. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.network.neutron [req-43890da9-108e-4594-aa3e-2fba274125c8 req-2497aff3-b371-4c46-ad21-866c4b70a7b3 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updating instance_info_cache with network_info: [{"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2226e309-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-43890da9-108e-4594-aa3e-2fba274125c8 req-2497aff3-b371-4c46-ad21-866c4b70a7b3 service nova] Releasing lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.059s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.295s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5fed6b49-8e02-486e-be6a-9ce2f1b583e1 tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "81148494-4e85-478e-b9d9-b7d2ec270083" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.182s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 877d406e-ca6f-416f-a569-3cdc1ae545b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf85594-1255-4383-b359-17ee78c71c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 3d166e9d-e05d-4378-b14b-0c10318490b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ada41106-bd49-4426-a12f-7033218ddb01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cd2f9cf3-f43d-40db-ada8-79c50589b1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:47:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:47:46 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:47:46 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:47:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:47:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQnfEhlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:47:48 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:47:48 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:47:48 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7489c7da-9c8b-44a1-bbae-a4bdd67d39cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:47:48 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7df85a-0915-4131-a597-e410cd2e15f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2] added
Aug 16 10:47:48 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f531b3-8103-4f6a-aa03-1e9f4c28799a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeb467a-5468-4cfc-8e7c-64629b88f0fc]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQnfEhlj {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQnfEhlj" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f866a51-22f1-4397-a21a-e92c14ad0173]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQnfEhlj'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a03f94-813f-4669-a86b-3086eabf74ec]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd91fdd-7722-496d-9b5d-2c5a70b82e24]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:47:48 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:47:48 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[16775385-15e4-451a-9d9a-cc4f88418710]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2, portal: 172.16.0.220,3260]
Aug 16 10:47:48 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2, portal: 172.16.0.220,3260] successful.
Aug 16 10:47:48 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[581bc9ef-9ad3-4da4-b63e-ce053e364ea4]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd03b83-542e-4779-bac8-5cd5e056771c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 (non-flash)
Aug 16 10:47:48 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:47:48 user nova-compute[73067]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 (non-flash)
Aug 16 10:47:48 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2befdc9c-aaea-4583-84c6-62b1e58c9155]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:47:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQnfEhlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:47:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:47:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23937646362393832', 'path': '/dev/sdf'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:47:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937646362393832', 'path': '/dev/sdf'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:47:49 user nova-compute[73067]: DEBUG nova.objects.instance [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'flavor' on Instance uuid ada41106-bd49-4426-a12f-7033218ddb01 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:47:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:47:49 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:47:49 user nova-compute[73067]:   <source dev="/dev/sdf"/>
Aug 16 10:47:49 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:47:49 user nova-compute[73067]:   <serial>d3eb6153-08c8-4a9c-ba3f-186168ee36f2</serial>
Aug 16 10:47:49 user nova-compute[73067]: </disk>
Aug 16 10:47:49 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:47:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:47:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:47:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] No VIF found with MAC fa:16:3e:18:eb:36, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:47:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-674800bf-ed28-4b76-bd5c-949ce817de38 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.690s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:47:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:47:50 user nova-compute[73067]: INFO nova.compute.manager [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Detaching volume d3eb6153-08c8-4a9c-ba3f-186168ee36f2
Aug 16 10:47:50 user nova-compute[73067]: INFO nova.virt.block_device [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Attempting to driver detach volume d3eb6153-08c8-4a9c-ba3f-186168ee36f2 from mountpoint /dev/vdb
Aug 16 10:47:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Attempting to detach device vdb from instance ada41106-bd49-4426-a12f-7033218ddb01 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:47:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:47:50 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:47:50 user nova-compute[73067]:   <source dev="/dev/sdf"/>
Aug 16 10:47:50 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:47:50 user nova-compute[73067]:   <serial>d3eb6153-08c8-4a9c-ba3f-186168ee36f2</serial>
Aug 16 10:47:50 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:47:50 user nova-compute[73067]: </disk>
Aug 16 10:47:50 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:47:50 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully detached device vdb from instance ada41106-bd49-4426-a12f-7033218ddb01 from the persistent domain config.
Aug 16 10:47:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ada41106-bd49-4426-a12f-7033218ddb01 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:47:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:47:50 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:47:50 user nova-compute[73067]:   <source dev="/dev/sdf"/>
Aug 16 10:47:50 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:47:50 user nova-compute[73067]:   <serial>d3eb6153-08c8-4a9c-ba3f-186168ee36f2</serial>
Aug 16 10:47:50 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:47:50 user nova-compute[73067]: </disk>
Aug 16 10:47:50 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182871.3089802, ada41106-bd49-4426-a12f-7033218ddb01 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ada41106-bd49-4426-a12f-7033218ddb01 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:47:51 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully detached device vdb from instance ada41106-bd49-4426-a12f-7033218ddb01 from the live domain config.
Aug 16 10:47:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQnfEhlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:47:51 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d16c62-d43b-4b76-a95e-86b45946c119]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41d5bda-cf32-4720-b37e-99fd328d152c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:47:51 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:47:51 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:47:51 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:47:51 user nova-compute[73067]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 (non-flash)
Aug 16 10:47:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:47:51 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:47:51 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:47:51 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:47:51 user nova-compute[73067]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 (non-flash)
Aug 16 10:47:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3584246440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2'): ({'sdf'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Removing single pathed devices sdf {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e827a83b-6a77-4b31-b74c-ce82c561350a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b9fdd4-b0b1-41e0-b5ac-f5833b001430]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Flushing IO for device /dev/sdf {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbc85ec-7102-4404-8cc9-f073930221a2]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.030s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9040b45-8893-4d1c-9e16-636ac29a98ca]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] SCSI volumes sdf have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f00aff-fc02-4d78-bc8e-1efb07c1a03f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3089e01a-f166-43e2-9b39-65e31f903689]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2, portal: 172.16.0.220,3260]
Aug 16 10:47:51 user nova-compute[73067]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2, portal: 172.16.0.220,3260] successful.
Aug 16 10:47:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3eb6153-08c8-4a9c-ba3f-186168ee36f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[29854f7e-99a6-407f-abab-46553a665f34]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] <== disconnect_volume: return (279ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:47:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:47:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:47:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:47:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:47:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:47:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:47:52 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:47:52 user nova-compute[73067]: DEBUG nova.objects.instance [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'flavor' on Instance uuid ada41106-bd49-4426-a12f-7033218ddb01 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:47:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b96c06c3-47a2-42a4-bbd4-42fb26be45e6 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:47:53 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Updating instance_info_cache with network_info: [{"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:47:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:47:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:47:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:47:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:47:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:47:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:47:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:47:54 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182859.1217988, 81148494-4e85-478e-b9d9-b7d2ec270083 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:47:54 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] VM Stopped (Lifecycle Event)
Aug 16 10:47:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0ea198ab-3a13-42dd-978b-fec907fed999 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:47:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:47:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:01 user nova-compute[73067]: INFO nova.compute.manager [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Terminating instance
Aug 16 10:48:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-228fb13b-6e4d-4a62-a415-bc5a231157b0 req-a4a1dd12-02bc-470b-937a-73dbeb171a2f service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-vif-unplugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-228fb13b-6e4d-4a62-a415-bc5a231157b0 req-a4a1dd12-02bc-470b-937a-73dbeb171a2f service nova] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-228fb13b-6e4d-4a62-a415-bc5a231157b0 req-a4a1dd12-02bc-470b-937a-73dbeb171a2f service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-228fb13b-6e4d-4a62-a415-bc5a231157b0 req-a4a1dd12-02bc-470b-937a-73dbeb171a2f service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-228fb13b-6e4d-4a62-a415-bc5a231157b0 req-a4a1dd12-02bc-470b-937a-73dbeb171a2f service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] No waiting events found dispatching network-vif-unplugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-228fb13b-6e4d-4a62-a415-bc5a231157b0 req-a4a1dd12-02bc-470b-937a-73dbeb171a2f service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-vif-unplugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:02 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Instance destroyed successfully.
Aug 16 10:48:02 user nova-compute[73067]: DEBUG nova.objects.instance [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'resources' on Instance uuid 877d406e-ca6f-416f-a569-3cdc1ae545b2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-488171748',display_name='tempest-ServerActionsTestOtherA-server-488171748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-488171748',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhgla1EGudnUgMo8sp69bGCzI9KExAhN9Vh+LGcPb7ZOjWlvBFg2zY0lGwEq2wsMYNd+BUSx+LuV7e4QllhSz+KH5UmhKYnFLZT6xPiJcUN2ahr8Bxzv1S1RvOd3h/nwA==',key_name='tempest-keypair-88160896',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-yv50xdsr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=877d406e-ca6f-416f-a569-3cdc1ae545b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "address": "fa:16:3e:4a:6a:a1", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f61fd6-dc", "ovs_interfaceid": "e7f61fd6-dc62-4568-b823-1a23f93b3e40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_vif [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7f61fd6-dc, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:02 user nova-compute[73067]: INFO os_vif [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6a:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7f61fd6-dc62-4568-b823-1a23f93b3e40,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f61fd6-dc')
Aug 16 10:48:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJWqLcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:48:02 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[478c1e69-4467-4317-b3b2-e71293279e25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c547ed-36c5-4732-bf01-ff4585885b94]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:48:02 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:48:02 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:48:02 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:48:02 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:48:02 user nova-compute[73067]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 (non-flash)
Aug 16 10:48:02 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:48:02 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:48:02 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3584391a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaab92b-32ca-4e40-b8f3-34238c02942a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f2a18a-47b3-436f-8840-cd50c1956273]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ea16e1-2ca9-4db6-9c0f-32649580b701]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[821a2dce-5f92-46d6-8e53-348c456115e2]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOaec9d47b-e0a6dd1db7dba002', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_aec9d47b', '/dev/disk/by-id/scsi-26530613664643164') {{(pid=84181) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[feddda67-5d72-4cd4-b62d-a59b403d7ebe]: (4, None) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.091s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[088fc25b-6ff2-4d93-9a3b-c878602cc515]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[15650684-1c3e-4dd4-b0c4-4587aaf290fc]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260]
Aug 16 10:48:02 user nova-compute[73067]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273, portal: 172.16.0.220,3260] successful.
Aug 16 10:48:02 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7132cfff-0821-4477-b0c2-07ee5c870273 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b327f502-2804-44f5-8f61-ad102f6dc136]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] <== disconnect_volume: return (361ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:48:02 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Deleting instance files /opt/stack/data/nova/instances/877d406e-ca6f-416f-a569-3cdc1ae545b2_del
Aug 16 10:48:02 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Deletion of /opt/stack/data/nova/instances/877d406e-ca6f-416f-a569-3cdc1ae545b2_del complete
Aug 16 10:48:02 user nova-compute[73067]: INFO nova.compute.manager [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 16 10:48:02 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:48:02 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:48:03 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:48:03 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Took 0.83 seconds to deallocate network for instance.
Aug 16 10:48:03 user nova-compute[73067]: DEBUG nova.compute.manager [req-98e74ae5-2969-4719-afe5-7b7aee1044ed req-80478664-22ba-428f-bbe2-471edc6751b6 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-vif-deleted-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:48:03 user nova-compute[73067]: INFO nova.compute.manager [req-98e74ae5-2969-4719-afe5-7b7aee1044ed req-80478664-22ba-428f-bbe2-471edc6751b6 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Neutron deleted interface e7f61fd6-dc62-4568-b823-1a23f93b3e40; detaching it from the instance and deleting it from the info cache
Aug 16 10:48:03 user nova-compute[73067]: DEBUG nova.network.neutron [req-98e74ae5-2969-4719-afe5-7b7aee1044ed req-80478664-22ba-428f-bbe2-471edc6751b6 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:48:03 user nova-compute[73067]: DEBUG nova.compute.manager [req-98e74ae5-2969-4719-afe5-7b7aee1044ed req-80478664-22ba-428f-bbe2-471edc6751b6 service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Detach interface failed, port_id=e7f61fd6-dc62-4568-b823-1a23f93b3e40, reason: Instance 877d406e-ca6f-416f-a569-3cdc1ae545b2 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:48:03 user nova-compute[73067]: DEBUG nova.compute.manager [req-f9dc2688-1a6d-456e-a535-cd2ae18fc15b req-23c703cb-b756-4f7f-8192-833c0c160c5a service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:48:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f9dc2688-1a6d-456e-a535-cd2ae18fc15b req-23c703cb-b756-4f7f-8192-833c0c160c5a service nova] Acquiring lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f9dc2688-1a6d-456e-a535-cd2ae18fc15b req-23c703cb-b756-4f7f-8192-833c0c160c5a service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f9dc2688-1a6d-456e-a535-cd2ae18fc15b req-23c703cb-b756-4f7f-8192-833c0c160c5a service nova] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:03 user nova-compute[73067]: DEBUG nova.compute.manager [req-f9dc2688-1a6d-456e-a535-cd2ae18fc15b req-23c703cb-b756-4f7f-8192-833c0c160c5a service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] No waiting events found dispatching network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:48:03 user nova-compute[73067]: WARNING nova.compute.manager [req-f9dc2688-1a6d-456e-a535-cd2ae18fc15b req-23c703cb-b756-4f7f-8192-833c0c160c5a service nova] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Received unexpected event network-vif-plugged-e7f61fd6-dc62-4568-b823-1a23f93b3e40 for instance with vm_state active and task_state deleting.
Aug 16 10:48:04 user nova-compute[73067]: INFO nova.compute.manager [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Took 0.94 seconds to detach 1 volumes for instance.
Aug 16 10:48:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Deleting volume: 7132cfff-0821-4477-b0c2-07ee5c870273 {{(pid=73067) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 10:48:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:04 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:48:04 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:48:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:04 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Deleted allocations for instance 877d406e-ca6f-416f-a569-3cdc1ae545b2
Aug 16 10:48:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-08e8cb3c-fabc-4b28-ab7c-09064c02b057 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "877d406e-ca6f-416f-a569-3cdc1ae545b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.544s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:17 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182882.2435648, 877d406e-ca6f-416f-a569-3cdc1ae545b2 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:48:17 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] VM Stopped (Lifecycle Event)
Aug 16 10:48:17 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c1b1bb69-ad0a-4660-a85b-16da7bf6c835 None None] [instance: 877d406e-ca6f-416f-a569-3cdc1ae545b2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:48:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:48:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:48:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:48:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:48:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:48:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-56c10efa-192e-4464-af69-5ebcef451ee8 req-e7f33975-8e0d-497c-ad1b-2308cdb50c8a service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-changed-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:48:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-56c10efa-192e-4464-af69-5ebcef451ee8 req-e7f33975-8e0d-497c-ad1b-2308cdb50c8a service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Refreshing instance network info cache due to event network-changed-22be01f1-3ab2-4867-a8f9-b1a050be6ff6. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:48:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-56c10efa-192e-4464-af69-5ebcef451ee8 req-e7f33975-8e0d-497c-ad1b-2308cdb50c8a service nova] Acquiring lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:48:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-56c10efa-192e-4464-af69-5ebcef451ee8 req-e7f33975-8e0d-497c-ad1b-2308cdb50c8a service nova] Acquired lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:48:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-56c10efa-192e-4464-af69-5ebcef451ee8 req-e7f33975-8e0d-497c-ad1b-2308cdb50c8a service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Refreshing network info cache for port 22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:48:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-56c10efa-192e-4464-af69-5ebcef451ee8 req-e7f33975-8e0d-497c-ad1b-2308cdb50c8a service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updated VIF entry in instance network info cache for port 22be01f1-3ab2-4867-a8f9-b1a050be6ff6. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:48:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-56c10efa-192e-4464-af69-5ebcef451ee8 req-e7f33975-8e0d-497c-ad1b-2308cdb50c8a service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updating instance_info_cache with network_info: [{"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:48:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-56c10efa-192e-4464-af69-5ebcef451ee8 req-e7f33975-8e0d-497c-ad1b-2308cdb50c8a service nova] Releasing lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-353906fb-e719-436c-b6e6-9cac5483fec4 req-c13d4383-0418-43d2-83ed-01fa260e1e52 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-changed-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-353906fb-e719-436c-b6e6-9cac5483fec4 req-c13d4383-0418-43d2-83ed-01fa260e1e52 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Refreshing instance network info cache due to event network-changed-22be01f1-3ab2-4867-a8f9-b1a050be6ff6. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-353906fb-e719-436c-b6e6-9cac5483fec4 req-c13d4383-0418-43d2-83ed-01fa260e1e52 service nova] Acquiring lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-353906fb-e719-436c-b6e6-9cac5483fec4 req-c13d4383-0418-43d2-83ed-01fa260e1e52 service nova] Acquired lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-353906fb-e719-436c-b6e6-9cac5483fec4 req-c13d4383-0418-43d2-83ed-01fa260e1e52 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Refreshing network info cache for port 22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:32 user nova-compute[73067]: INFO nova.compute.manager [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Detaching volume a9951460-1e67-4ccd-a087-485b9e28717b
Aug 16 10:48:32 user nova-compute[73067]: INFO nova.virt.block_device [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Attempting to driver detach volume a9951460-1e67-4ccd-a087-485b9e28717b from mountpoint /dev/vdb
Aug 16 10:48:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Attempting to detach device vdb from instance 3d166e9d-e05d-4378-b14b-0c10318490b8 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:48:32 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:48:32 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:48:32 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:48:32 user nova-compute[73067]:   <serial>a9951460-1e67-4ccd-a087-485b9e28717b</serial>
Aug 16 10:48:32 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 10:48:32 user nova-compute[73067]: </disk>
Aug 16 10:48:32 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:48:32 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Successfully detached device vdb from instance 3d166e9d-e05d-4378-b14b-0c10318490b8 from the persistent domain config.
Aug 16 10:48:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d166e9d-e05d-4378-b14b-0c10318490b8 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:48:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:48:32 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:48:32 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:48:32 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:48:32 user nova-compute[73067]:   <serial>a9951460-1e67-4ccd-a087-485b9e28717b</serial>
Aug 16 10:48:32 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 10:48:32 user nova-compute[73067]: </disk>
Aug 16 10:48:32 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-353906fb-e719-436c-b6e6-9cac5483fec4 req-c13d4383-0418-43d2-83ed-01fa260e1e52 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updated VIF entry in instance network info cache for port 22be01f1-3ab2-4867-a8f9-b1a050be6ff6. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-353906fb-e719-436c-b6e6-9cac5483fec4 req-c13d4383-0418-43d2-83ed-01fa260e1e52 service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updating instance_info_cache with network_info: [{"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-353906fb-e719-436c-b6e6-9cac5483fec4 req-c13d4383-0418-43d2-83ed-01fa260e1e52 service nova] Releasing lock "refresh_cache-3d166e9d-e05d-4378-b14b-0c10318490b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692182913.3030787, 3d166e9d-e05d-4378-b14b-0c10318490b8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:48:33 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Successfully detached device vdb from instance 3d166e9d-e05d-4378-b14b-0c10318490b8 from the live domain config.
Aug 16 10:48:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PVfkpKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:48:33 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1da0d85-890c-4316-913a-574cd7192b37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6193da2a-8a90-44fe-ad2e-f92106cba41b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:48:33 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:48:33 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:48:33 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:48:33 user nova-compute[73067]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b (non-flash)
Aug 16 10:48:33 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:48:33 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35843b4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a341a3d1-bdc6-47ac-b06a-ad873ce728e3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6ef09f-ee32-4953-8d0e-9a4b62debd6b]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a94e73e-0185-4a1e-b4e9-0328189530d6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[727eec05-0940-43a2-ba3c-12269f2b37ac]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1f6b02-2142-438d-9ac0-d2f0912695c6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[92936501-4958-4a7b-abd1-045ac964afc2]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260]
Aug 16 10:48:33 user nova-compute[73067]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b, portal: 172.16.0.220,3260] successful.
Aug 16 10:48:33 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9951460-1e67-4ccd-a087-485b9e28717b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd55bad-9c5d-41d6-9225-cdb70585a616]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] <== disconnect_volume: return (257ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:48:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:48:34 user nova-compute[73067]: DEBUG nova.objects.instance [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'flavor' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:48:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-93e210f1-fe55-4e95-9536-7e4bcc210bdd tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.609s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:48:38 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:48:38 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:41 user nova-compute[73067]: INFO nova.compute.manager [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Terminating instance
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-5b16cd80-7b32-438a-86cd-c1ce65cc05bf req-3241101b-5b7a-430d-8340-6d61c88f658f service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received event network-vif-unplugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5b16cd80-7b32-438a-86cd-c1ce65cc05bf req-3241101b-5b7a-430d-8340-6d61c88f658f service nova] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5b16cd80-7b32-438a-86cd-c1ce65cc05bf req-3241101b-5b7a-430d-8340-6d61c88f658f service nova] Lock "ada41106-bd49-4426-a12f-7033218ddb01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5b16cd80-7b32-438a-86cd-c1ce65cc05bf req-3241101b-5b7a-430d-8340-6d61c88f658f service nova] Lock "ada41106-bd49-4426-a12f-7033218ddb01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-5b16cd80-7b32-438a-86cd-c1ce65cc05bf req-3241101b-5b7a-430d-8340-6d61c88f658f service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] No waiting events found dispatching network-vif-unplugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-5b16cd80-7b32-438a-86cd-c1ce65cc05bf req-3241101b-5b7a-430d-8340-6d61c88f658f service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received event network-vif-unplugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Instance destroyed successfully.
Aug 16 10:48:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lazy-loading 'resources' on Instance uuid ada41106-bd49-4426-a12f-7033218ddb01 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1367568229',display_name='tempest-AttachVolumeNegativeTest-server-1367568229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1367568229',id=33,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwwQRWbf4hH7AJaH/37tv2wHN6qtOPePmiQmWLbz7FiXepbCkir150ycUSgULDs33TIGiKiwK+VqnALHsOCnrAF72qwNMjvnX8Oz9WL65TVPswlKKRxSkBlkfMTNAJiqA==',key_name='tempest-keypair-1859943190',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:45:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ce3a633ff54025aebcee0c30986ad9',ramdisk_id='',reservation_id='r-9e6gpgb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-630141842',owner_user_name='tempest-AttachVolumeNegativeTest-630141842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:45:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be44e520761a493aab4b2a5973edd39c',uuid=ada41106-bd49-4426-a12f-7033218ddb01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converting VIF {"id": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "address": "fa:16:3e:18:eb:36", "network": {"id": "206e0a30-ee66-4ed0-a60d-7723dcafca3b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784324009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ce3a633ff54025aebcee0c30986ad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap249ee321-c5", "ovs_interfaceid": "249ee321-c527-4e29-8b0a-4acf1ef9b611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=249ee321-c527-4e29-8b0a-4acf1ef9b611,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap249ee321-c5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG os_vif [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=249ee321-c527-4e29-8b0a-4acf1ef9b611,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap249ee321-c5') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap249ee321-c5, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:48:41 user nova-compute[73067]: INFO os_vif [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=249ee321-c527-4e29-8b0a-4acf1ef9b611,network=Network(206e0a30-ee66-4ed0-a60d-7723dcafca3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap249ee321-c5')
Aug 16 10:48:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Deleting instance files /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01_del
Aug 16 10:48:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Deletion of /opt/stack/data/nova/instances/ada41106-bd49-4426-a12f-7033218ddb01_del complete
Aug 16 10:48:42 user nova-compute[73067]: INFO nova.compute.manager [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: ada41106-bd49-4426-a12f-7033218ddb01] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:48:42 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Took 0.75 seconds to deallocate network for instance.
Aug 16 10:48:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-6d253d5b-f6f5-4b57-ae11-16b30eee9669 req-b1723d2c-9ca7-42ee-aef9-c48b81e8f129 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received event network-vif-deleted-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:48:42 user nova-compute[73067]: INFO nova.compute.manager [req-6d253d5b-f6f5-4b57-ae11-16b30eee9669 req-b1723d2c-9ca7-42ee-aef9-c48b81e8f129 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Neutron deleted interface 249ee321-c527-4e29-8b0a-4acf1ef9b611; detaching it from the instance and deleting it from the info cache
Aug 16 10:48:42 user nova-compute[73067]: DEBUG nova.network.neutron [req-6d253d5b-f6f5-4b57-ae11-16b30eee9669 req-b1723d2c-9ca7-42ee-aef9-c48b81e8f129 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-6d253d5b-f6f5-4b57-ae11-16b30eee9669 req-b1723d2c-9ca7-42ee-aef9-c48b81e8f129 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Detach interface failed, port_id=249ee321-c527-4e29-8b0a-4acf1ef9b611, reason: Instance ada41106-bd49-4426-a12f-7033218ddb01 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:43 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Deleted allocations for instance ada41106-bd49-4426-a12f-7033218ddb01
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1b9aef78-4d8b-4653-a1c9-793500f9c002 tempest-AttachVolumeNegativeTest-630141842 tempest-AttachVolumeNegativeTest-630141842-project-member] Lock "ada41106-bd49-4426-a12f-7033218ddb01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.333s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-a5e327b1-f547-4d1f-9592-34e47f7a2caf req-9bed908f-4fd5-4318-9687-14f1b2e80372 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received event network-vif-plugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5e327b1-f547-4d1f-9592-34e47f7a2caf req-9bed908f-4fd5-4318-9687-14f1b2e80372 service nova] Acquiring lock "ada41106-bd49-4426-a12f-7033218ddb01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5e327b1-f547-4d1f-9592-34e47f7a2caf req-9bed908f-4fd5-4318-9687-14f1b2e80372 service nova] Lock "ada41106-bd49-4426-a12f-7033218ddb01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5e327b1-f547-4d1f-9592-34e47f7a2caf req-9bed908f-4fd5-4318-9687-14f1b2e80372 service nova] Lock "ada41106-bd49-4426-a12f-7033218ddb01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-a5e327b1-f547-4d1f-9592-34e47f7a2caf req-9bed908f-4fd5-4318-9687-14f1b2e80372 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] No waiting events found dispatching network-vif-plugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:48:43 user nova-compute[73067]: WARNING nova.compute.manager [req-a5e327b1-f547-4d1f-9592-34e47f7a2caf req-9bed908f-4fd5-4318-9687-14f1b2e80372 service nova] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Received unexpected event network-vif-plugged-249ee321-c527-4e29-8b0a-4acf1ef9b611 for instance with vm_state deleted and task_state None.
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:48:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:48:44 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:48:44 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7610MB free_disk=24.99596405029297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 311f3d35-c279-4b63-b3e1-7528c30ac659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf85594-1255-4383-b359-17ee78c71c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 3d166e9d-e05d-4378-b14b-0c10318490b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cd2f9cf3-f43d-40db-ada8-79c50589b1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:48:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:48 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:48:48 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:48:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:48:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-4bf85594-1255-4383-b359-17ee78c71c6b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:48:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-4bf85594-1255-4383-b359-17ee78c71c6b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:48:48 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:48:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Updating instance_info_cache with network_info: [{"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:48:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-4bf85594-1255-4383-b359-17ee78c71c6b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:48:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:48:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:48:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:48:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:48:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:48:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:48:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:48:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:48:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:48:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:48:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:56 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182921.8940067, ada41106-bd49-4426-a12f-7033218ddb01 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:48:56 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: ada41106-bd49-4426-a12f-7033218ddb01] VM Stopped (Lifecycle Event)
Aug 16 10:48:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-b2ddf69e-e6d7-4f7e-a118-c1dce6d982e7 None None] [instance: ada41106-bd49-4426-a12f-7033218ddb01] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:48:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "311f3d35-c279-4b63-b3e1-7528c30ac659" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:58 user nova-compute[73067]: INFO nova.compute.manager [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Terminating instance
Aug 16 10:48:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-66e377db-4942-45d1-9381-5973175c82ed req-5dae9637-7a8d-4fe7-994f-cbed84c67987 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received event network-vif-unplugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-66e377db-4942-45d1-9381-5973175c82ed req-5dae9637-7a8d-4fe7-994f-cbed84c67987 service nova] Acquiring lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-66e377db-4942-45d1-9381-5973175c82ed req-5dae9637-7a8d-4fe7-994f-cbed84c67987 service nova] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-66e377db-4942-45d1-9381-5973175c82ed req-5dae9637-7a8d-4fe7-994f-cbed84c67987 service nova] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-66e377db-4942-45d1-9381-5973175c82ed req-5dae9637-7a8d-4fe7-994f-cbed84c67987 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] No waiting events found dispatching network-vif-unplugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:48:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-66e377db-4942-45d1-9381-5973175c82ed req-5dae9637-7a8d-4fe7-994f-cbed84c67987 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received event network-vif-unplugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:48:59 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Instance destroyed successfully.
Aug 16 10:48:59 user nova-compute[73067]: DEBUG nova.objects.instance [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lazy-loading 'resources' on Instance uuid 311f3d35-c279-4b63-b3e1-7528c30ac659 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-282275175',display_name='tempest-ServerActionsTestOtherA-server-282275175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-282275175',id=3,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhgla1EGudnUgMo8sp69bGCzI9KExAhN9Vh+LGcPb7ZOjWlvBFg2zY0lGwEq2wsMYNd+BUSx+LuV7e4QllhSz+KH5UmhKYnFLZT6xPiJcUN2ahr8Bxzv1S1RvOd3h/nwA==',key_name='tempest-keypair-88160896',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b7b37f1cdfe41ddb6545c23a5b5c8b4',ramdisk_id='',reservation_id='r-qvk7hj1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1833692287',owner_user_name='tempest-ServerActionsTestOtherA-1833692287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:29:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4cbf9cec1c4c438adbbab6bd7f794c',uuid=311f3d35-c279-4b63-b3e1-7528c30ac659,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converting VIF {"id": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "address": "fa:16:3e:2a:e8:fd", "network": {"id": "1c10c661-4600-4775-9493-994dc45e4130", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-681058576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7b37f1cdfe41ddb6545c23a5b5c8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d884641-f0", "ovs_interfaceid": "3d884641-f0de-4b61-a8e7-c7791ec28e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3d884641-f0de-4b61-a8e7-c7791ec28e2d,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d884641-f0') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG os_vif [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3d884641-f0de-4b61-a8e7-c7791ec28e2d,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d884641-f0') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d884641-f0, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:48:59 user nova-compute[73067]: INFO os_vif [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3d884641-f0de-4b61-a8e7-c7791ec28e2d,network=Network(1c10c661-4600-4775-9493-994dc45e4130),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d884641-f0')
Aug 16 10:48:59 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Deleting instance files /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659_del
Aug 16 10:48:59 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Deletion of /opt/stack/data/nova/instances/311f3d35-c279-4b63-b3e1-7528c30ac659_del complete
Aug 16 10:48:59 user nova-compute[73067]: INFO nova.compute.manager [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 10:48:59 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:48:59 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Took 0.45 seconds to deallocate network for instance.
Aug 16 10:48:59 user nova-compute[73067]: DEBUG nova.compute.manager [req-f7c15504-8777-4e69-804b-12bcd9536092 req-18f98db3-deb5-4abc-b1bc-0e661b54ac76 service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received event network-vif-deleted-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:48:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:00 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:49:00 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:49:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:00 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Deleted allocations for instance 311f3d35-c279-4b63-b3e1-7528c30ac659
Aug 16 10:49:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a2789699-4049-4f4d-acd1-bc1c2285cae8 tempest-ServerActionsTestOtherA-1833692287 tempest-ServerActionsTestOtherA-1833692287-project-member] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.877s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-0a2c26d5-23e9-41e8-8cde-93cd4a8e8442 req-34753133-d682-4244-a876-bc0fc67a86fe service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received event network-vif-plugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0a2c26d5-23e9-41e8-8cde-93cd4a8e8442 req-34753133-d682-4244-a876-bc0fc67a86fe service nova] Acquiring lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0a2c26d5-23e9-41e8-8cde-93cd4a8e8442 req-34753133-d682-4244-a876-bc0fc67a86fe service nova] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0a2c26d5-23e9-41e8-8cde-93cd4a8e8442 req-34753133-d682-4244-a876-bc0fc67a86fe service nova] Lock "311f3d35-c279-4b63-b3e1-7528c30ac659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-0a2c26d5-23e9-41e8-8cde-93cd4a8e8442 req-34753133-d682-4244-a876-bc0fc67a86fe service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] No waiting events found dispatching network-vif-plugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:00 user nova-compute[73067]: WARNING nova.compute.manager [req-0a2c26d5-23e9-41e8-8cde-93cd4a8e8442 req-34753133-d682-4244-a876-bc0fc67a86fe service nova] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Received unexpected event network-vif-plugged-3d884641-f0de-4b61-a8e7-c7791ec28e2d for instance with vm_state deleted and task_state None.
Aug 16 10:49:01 user nova-compute[73067]: INFO nova.compute.manager [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Rescuing
Aug 16 10:49:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:49:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquired lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:49:01 user nova-compute[73067]: DEBUG nova.network.neutron [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:49:02 user nova-compute[73067]: DEBUG nova.network.neutron [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Updating instance_info_cache with network_info: [{"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:49:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Releasing lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:49:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-1937cc59-c0c7-44ea-a594-f0af838bf400 req-4a3c74c7-80ef-40db-8804-97b343d93ed0 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-unplugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1937cc59-c0c7-44ea-a594-f0af838bf400 req-4a3c74c7-80ef-40db-8804-97b343d93ed0 service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1937cc59-c0c7-44ea-a594-f0af838bf400 req-4a3c74c7-80ef-40db-8804-97b343d93ed0 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1937cc59-c0c7-44ea-a594-f0af838bf400 req-4a3c74c7-80ef-40db-8804-97b343d93ed0 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-1937cc59-c0c7-44ea-a594-f0af838bf400 req-4a3c74c7-80ef-40db-8804-97b343d93ed0 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-unplugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:02 user nova-compute[73067]: WARNING nova.compute.manager [req-1937cc59-c0c7-44ea-a594-f0af838bf400 req-4a3c74c7-80ef-40db-8804-97b343d93ed0 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-unplugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state active and task_state rescuing.
Aug 16 10:49:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:03 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Instance destroyed successfully.
Aug 16 10:49:03 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Attempting a stable device rescue
Aug 16 10:49:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73067) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 10:49:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Instance directory exists: not creating {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 10:49:03 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Creating image(s)
Aug 16 10:49:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "/opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "/opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:03 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'trusted_certs' on Instance uuid cd2f9cf3-f43d-40db-ada8-79c50589b1b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "b6b06079bc3e0a1373dbae111adba5a3922a686e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "b6b06079bc3e0a1373dbae111adba5a3922a686e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e.part --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e.part --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG nova.virt.images [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] 43315c6b-9933-42d7-884f-c61f30915809 was qcow2, converting to raw {{(pid=73067) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e.part /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e.converted {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-39df71ba-362f-4fd2-bc1c-94791e93d391 req-027f8078-ff2c-46e4-88f6-848feb4785d3 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-39df71ba-362f-4fd2-bc1c-94791e93d391 req-027f8078-ff2c-46e4-88f6-848feb4785d3 service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-39df71ba-362f-4fd2-bc1c-94791e93d391 req-027f8078-ff2c-46e4-88f6-848feb4785d3 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-39df71ba-362f-4fd2-bc1c-94791e93d391 req-027f8078-ff2c-46e4-88f6-848feb4785d3 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-39df71ba-362f-4fd2-bc1c-94791e93d391 req-027f8078-ff2c-46e4-88f6-848feb4785d3 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:04 user nova-compute[73067]: WARNING nova.compute.manager [req-39df71ba-362f-4fd2-bc1c-94791e93d391 req-027f8078-ff2c-46e4-88f6-848feb4785d3 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state active and task_state rescuing.
Aug 16 10:49:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e.part /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e.converted" returned: 0 in 0.268s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:04 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e.converted --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "b6b06079bc3e0a1373dbae111adba5a3922a686e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.713s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "b6b06079bc3e0a1373dbae111adba5a3922a686e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "b6b06079bc3e0a1373dbae111adba5a3922a686e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e --force-share --output=json" returned: 0 in 0.169s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e,backing_fmt=raw /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e,backing_fmt=raw /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue" returned: 0 in 0.050s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "b6b06079bc3e0a1373dbae111adba5a3922a686e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'migration_context' on Instance uuid cd2f9cf3-f43d-40db-ada8-79c50589b1b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Start _get_guest_xml network_info=[{"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "vif_mac": "fa:16:3e:22:de:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '43315c6b-9933-42d7-884f-c61f30915809', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhWvyqYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'cd2f9cf3-f43d-40db-ada8-79c50589b1b8', 'attached_at': '', 'detached_at': '', 'volume_id': '921d230b-3591-4cb2-b81a-b4988d120cba', 'serial': '921d230b-3591-4cb2-b81a-b4988d120cba'}, 'delete_on_termination': False, 'attachment_id': 'bd560867-9f57-4fc3-9a43-22ca7b9b4ec2', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'resources' on Instance uuid cd2f9cf3-f43d-40db-ada8-79c50589b1b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'numa_topology' on Instance uuid cd2f9cf3-f43d-40db-ada8-79c50589b1b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:05 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:49:05 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'vcpu_model' on Instance uuid cd2f9cf3-f43d-40db-ada8-79c50589b1b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhWvyqYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:49:05 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:49:05 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:49:05 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef18d48-3ef3-4555-a004-32f1a6e22a2b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UhWvyqYZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 10:49:05 user nova-compute[73067]: node.name = iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba
Aug 16 10:49:05 user nova-compute[73067]: node.tpgt = -1
Aug 16 10:49:05 user nova-compute[73067]: node.startup = automatic
Aug 16 10:49:05 user nova-compute[73067]: node.leading_login = No
Aug 16 10:49:05 user nova-compute[73067]: iface.iscsi_ifacename = default
Aug 16 10:49:05 user nova-compute[73067]: iface.net_ifacename = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.ipaddress = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.prefix_len = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.hwaddress = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.transport_name = tcp
Aug 16 10:49:05 user nova-compute[73067]: iface.initiatorname = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.state = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.vlan_id = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.vlan_priority = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.vlan_state = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.iface_num = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.mtu = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.port = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.bootproto = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.subnet_mask = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.gateway = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.dhcp_alt_client_id = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.dhcp_dns = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.dhcp_learn_iqn = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.dhcp_vendor_id_state = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.dhcp_vendor_id = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.dhcp_slp_da = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.fragmentation = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.gratuitous_arp = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.incoming_forwarding = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.tos_state = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.tos = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.ttl = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.delayed_ack = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.tcp_nagle = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.tcp_wsf_state = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.tcp_wsf = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.tcp_timer_scale = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.tcp_timestamp = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.redirect = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.def_task_mgmt_timeout = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.header_digest = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.data_digest = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.immediate_data = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.initial_r2t = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.data_seq_inorder = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.data_pdu_inorder = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.erl = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.max_receive_data_len = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.first_burst_len = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.max_outstanding_r2t = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.max_burst_len = 0
Aug 16 10:49:05 user nova-compute[73067]: iface.chap_auth = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.bidi_chap = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.strict_login_compliance = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.discovery_auth = <empty>
Aug 16 10:49:05 user nova-compute[73067]: iface.discovery_logout = <empty>
Aug 16 10:49:05 user nova-compute[73067]: node.discovery_address = <empty>
Aug 16 10:49:05 user nova-compute[73067]: node.discovery_port = 0
Aug 16 10:49:05 user nova-compute[73067]: node.discovery_type = static
Aug 16 10:49:05 user nova-compute[73067]: node.session.initial_cmdsn = 0
Aug 16 10:49:05 user nova-compute[73067]: node.session.initial_login_retry_max = 8
Aug 16 10:49:05 user nova-compute[73067]: node.session.xmit_thread_priority = -20
Aug 16 10:49:05 user nova-compute[73067]: node.session.cmds_max = 128
Aug 16 10:49:05 user nova-compute[73067]: node.session.queue_depth = 32
Aug 16 10:49:05 user nova-compute[73067]: node.session.nr_sessions = 1
Aug 16 10:49:05 user nova-compute[73067]: node.session.auth.authmethod = CHAP
Aug 16 10:49:05 user nova-compute[73067]: node.session.auth.username = UhWvyqYZ
Aug 16 10:49:05 user nova-compute[73067]: node.session.auth.password = ***
Aug 16 10:49:05 user nova-compute[73067]: node.session.auth.username_in = <empty>
Aug 16 10:49:05 user nova-compute[73067]: node.session.auth.password_in = <empty>
Aug 16 10:49:05 user nova-compute[73067]: node.session.auth.chap_algs = MD5
Aug 16 10:49:05 user nova-compute[73067]: node.session.timeo.replacement_timeout = 120
Aug 16 10:49:05 user nova-compute[73067]: node.session.err_timeo.abort_timeout = 15
Aug 16 10:49:05 user nova-compute[73067]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 10:49:05 user nova-compute[73067]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 10:49:05 user nova-compute[73067]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 10:49:05 user nova-compute[73067]: node.session.iscsi.FastAbort = Yes
Aug 16 10:49:05 user nova-compute[73067]: node.session.iscsi.InitialR2T = No
Aug 16 10:49:05 user nova-compute[73067]: node.session.iscsi.ImmediateData = Yes
Aug 16 10:49:05 user nova-compute[73067]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 10:49:05 user nova-compute[73067]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 10:49:05 user nova-compute[73067]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 10:49:05 user nova-compute[73067]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 10:49:05 user nova-compute[73067]: node.session.iscsi.MaxConnections = 1
Aug 16 10:49:05 user nova-compute[73067]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 10:49:05 user nova-compute[73067]: node.session.iscsi.ERL = 0
Aug 16 10:49:05 user nova-compute[73067]: node.session.scan = manual
Aug 16 10:49:05 user nova-compute[73067]: node.session.reopen_max = 0
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].address = 172.16.0.220
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].port = 3260
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].startup = manual
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].tcp.window_size = 524288
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].tcp.type_of_service = 0
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].timeo.logout_timeout = 15
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].timeo.login_timeout = 15
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].timeo.auth_timeout = 45
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].iscsi.DataDigest = None
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].iscsi.IFMarker = No
Aug 16 10:49:05 user nova-compute[73067]: node.conn[0].iscsi.OFMarker = No
Aug 16 10:49:05 user nova-compute[73067]: # END RECORD
Aug 16 10:49:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5038582f-4d5b-4f07-a90f-0d365ae23750]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[df684115-196c-46e3-b698-80978dfe2b3a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhWvyqYZ {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhWvyqYZ" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a93071e-f26e-42a9-af2a-52df7ce515dc]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UhWvyqYZ'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e624145-3ab7-4a70-8bc6-8f50bac8f11e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db68a4c-ed7c-4284-85fb-adff60b471b3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:49:05 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:49:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:49:05 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:49:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.134s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] HCTL ('35', '0', '0', 0) found on session 36 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3b5b4a-cb73-4a04-94b1-6c9616e8f96b]: (4, ('0 0 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Searching for a device in session 36 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhWvyqYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.157s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] <== connect_volume: return (159ms) {'type': 'block', 'scsi_wwn': '23361663735666463', 'path': '/dev/sdd'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361663735666463', 'path': '/dev/sdd'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-346489190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-346489190',id=35,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:47:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-mjml73w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:47:42Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=cd2f9cf3-f43d-40db-ada8-79c50589b1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "vif_mac": "fa:16:3e:22:de:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "vif_mac": "fa:16:3e:22:de:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:de:d4,bridge_name='br-int',has_traffic_filtering=True,id=494d5c6a-e5de-4fe9-b980-b0ac316cbb56,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d5c6a-e5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'pci_devices' on Instance uuid cd2f9cf3-f43d-40db-ada8-79c50589b1b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:49:05 user nova-compute[73067]:   <uuid>cd2f9cf3-f43d-40db-ada8-79c50589b1b8</uuid>
Aug 16 10:49:05 user nova-compute[73067]:   <name>instance-00000023</name>
Aug 16 10:49:05 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:49:05 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:49:05 user nova-compute[73067]:   <metadata>
Aug 16 10:49:05 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:49:05 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:49:05 user nova-compute[73067]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-346489190</nova:name>
Aug 16 10:49:05 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:49:05</nova:creationTime>
Aug 16 10:49:05 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:49:05 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:49:05 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:49:05 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:49:05 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:49:05 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:49:05 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:49:05 user nova-compute[73067]:       <nova:owner>
Aug 16 10:49:05 user nova-compute[73067]:         <nova:user uuid="d3b135edcf064595b8d93052903696a7">tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member</nova:user>
Aug 16 10:49:05 user nova-compute[73067]:         <nova:project uuid="4d03e64450654fd693d6a1bd43017880">tempest-ServerBootFromVolumeStableRescueTest-1973630968</nova:project>
Aug 16 10:49:05 user nova-compute[73067]:       </nova:owner>
Aug 16 10:49:05 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:49:05 user nova-compute[73067]:       <nova:ports>
Aug 16 10:49:05 user nova-compute[73067]:         <nova:port uuid="494d5c6a-e5de-4fe9-b980-b0ac316cbb56">
Aug 16 10:49:05 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 10:49:05 user nova-compute[73067]:         </nova:port>
Aug 16 10:49:05 user nova-compute[73067]:       </nova:ports>
Aug 16 10:49:05 user nova-compute[73067]:     </nova:instance>
Aug 16 10:49:05 user nova-compute[73067]:   </metadata>
Aug 16 10:49:05 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:49:05 user nova-compute[73067]:     <system>
Aug 16 10:49:05 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:49:05 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:49:05 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:49:05 user nova-compute[73067]:       <entry name="serial">cd2f9cf3-f43d-40db-ada8-79c50589b1b8</entry>
Aug 16 10:49:05 user nova-compute[73067]:       <entry name="uuid">cd2f9cf3-f43d-40db-ada8-79c50589b1b8</entry>
Aug 16 10:49:05 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:49:05 user nova-compute[73067]:     </system>
Aug 16 10:49:05 user nova-compute[73067]:   </sysinfo>
Aug 16 10:49:05 user nova-compute[73067]:   <os>
Aug 16 10:49:05 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:49:05 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:49:05 user nova-compute[73067]:   </os>
Aug 16 10:49:05 user nova-compute[73067]:   <features>
Aug 16 10:49:05 user nova-compute[73067]:     <acpi/>
Aug 16 10:49:05 user nova-compute[73067]:     <apic/>
Aug 16 10:49:05 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:49:05 user nova-compute[73067]:   </features>
Aug 16 10:49:05 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:49:05 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:49:05 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:49:05 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:49:05 user nova-compute[73067]:   </clock>
Aug 16 10:49:05 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:49:05 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:49:05 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:49:05 user nova-compute[73067]:   </cpu>
Aug 16 10:49:05 user nova-compute[73067]:   <devices>
Aug 16 10:49:05 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:49:05 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:49:05 user nova-compute[73067]:       <source dev="/dev/sdd"/>
Aug 16 10:49:05 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:49:05 user nova-compute[73067]:       <serial>921d230b-3591-4cb2-b81a-b4988d120cba</serial>
Aug 16 10:49:05 user nova-compute[73067]:     </disk>
Aug 16 10:49:05 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:49:05 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:49:05 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue"/>
Aug 16 10:49:05 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:49:05 user nova-compute[73067]:       <boot order="1"/>
Aug 16 10:49:05 user nova-compute[73067]:     </disk>
Aug 16 10:49:05 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:49:05 user nova-compute[73067]:       <mac address="fa:16:3e:22:de:d4"/>
Aug 16 10:49:05 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:49:05 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:49:05 user nova-compute[73067]:       <target dev="tap494d5c6a-e5"/>
Aug 16 10:49:05 user nova-compute[73067]:     </interface>
Aug 16 10:49:05 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:49:05 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/console.log" append="off"/>
Aug 16 10:49:05 user nova-compute[73067]:     </serial>
Aug 16 10:49:05 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:49:05 user nova-compute[73067]:     <video>
Aug 16 10:49:05 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:49:05 user nova-compute[73067]:     </video>
Aug 16 10:49:05 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:49:05 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:49:05 user nova-compute[73067]:     </rng>
Aug 16 10:49:05 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:49:05 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:49:05 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:49:05 user nova-compute[73067]:     </memballoon>
Aug 16 10:49:05 user nova-compute[73067]:   </devices>
Aug 16 10:49:05 user nova-compute[73067]: </domain>
Aug 16 10:49:05 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:49:05 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Instance destroyed successfully.
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:49:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] No VIF found with MAC fa:16:3e:22:de:d4, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:49:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:07 user nova-compute[73067]: DEBUG nova.compute.manager [req-47ecd491-62c4-4095-877f-2e85608dad14 req-0e75f7e8-ca2c-405f-b698-186c03cbbeb1 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-47ecd491-62c4-4095-877f-2e85608dad14 req-0e75f7e8-ca2c-405f-b698-186c03cbbeb1 service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-47ecd491-62c4-4095-877f-2e85608dad14 req-0e75f7e8-ca2c-405f-b698-186c03cbbeb1 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-47ecd491-62c4-4095-877f-2e85608dad14 req-0e75f7e8-ca2c-405f-b698-186c03cbbeb1 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:07 user nova-compute[73067]: DEBUG nova.compute.manager [req-47ecd491-62c4-4095-877f-2e85608dad14 req-0e75f7e8-ca2c-405f-b698-186c03cbbeb1 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:07 user nova-compute[73067]: WARNING nova.compute.manager [req-47ecd491-62c4-4095-877f-2e85608dad14 req-0e75f7e8-ca2c-405f-b698-186c03cbbeb1 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state active and task_state rescuing.
Aug 16 10:49:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for cd2f9cf3-f43d-40db-ada8-79c50589b1b8 due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:49:09 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182949.2527063, cd2f9cf3-f43d-40db-ada8-79c50589b1b8 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:49:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] VM Resumed (Lifecycle Event)
Aug 16 10:49:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-6c6f8e94-03b6-42d9-81bb-79beb0675974 req-76514054-db68-4d0f-8039-783f4559e798 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c6f8e94-03b6-42d9-81bb-79beb0675974 req-76514054-db68-4d0f-8039-783f4559e798 service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c6f8e94-03b6-42d9-81bb-79beb0675974 req-76514054-db68-4d0f-8039-783f4559e798 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c6f8e94-03b6-42d9-81bb-79beb0675974 req-76514054-db68-4d0f-8039-783f4559e798 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-6c6f8e94-03b6-42d9-81bb-79beb0675974 req-76514054-db68-4d0f-8039-783f4559e798 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:09 user nova-compute[73067]: WARNING nova.compute.manager [req-6c6f8e94-03b6-42d9-81bb-79beb0675974 req-76514054-db68-4d0f-8039-783f4559e798 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state active and task_state rescuing.
Aug 16 10:49:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2a475aa0-8013-47dc-a81f-42d08329598a tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:49:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 10:49:09 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182949.253934, cd2f9cf3-f43d-40db-ada8-79c50589b1b8 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:49:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] VM Started (Lifecycle Event)
Aug 16 10:49:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:49:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:14 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182939.2602775, 311f3d35-c279-4b63-b3e1-7528c30ac659 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:49:14 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] VM Stopped (Lifecycle Event)
Aug 16 10:49:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9ffa791f-e089-4b79-8b13-015af9bd1761 None None] [instance: 311f3d35-c279-4b63-b3e1-7528c30ac659] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-48a5bb70-051d-4fd9-b2a4-d0e15964d064 req-de603d3e-fe5e-44df-8106-722f475f273a service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-changed-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-48a5bb70-051d-4fd9-b2a4-d0e15964d064 req-de603d3e-fe5e-44df-8106-722f475f273a service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Refreshing instance network info cache due to event network-changed-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-48a5bb70-051d-4fd9-b2a4-d0e15964d064 req-de603d3e-fe5e-44df-8106-722f475f273a service nova] Acquiring lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-48a5bb70-051d-4fd9-b2a4-d0e15964d064 req-de603d3e-fe5e-44df-8106-722f475f273a service nova] Acquired lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG nova.network.neutron [req-48a5bb70-051d-4fd9-b2a4-d0e15964d064 req-de603d3e-fe5e-44df-8106-722f475f273a service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Refreshing network info cache for port 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG nova.objects.instance [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'flavor' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG nova.network.neutron [req-48a5bb70-051d-4fd9-b2a4-d0e15964d064 req-de603d3e-fe5e-44df-8106-722f475f273a service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updated VIF entry in instance network info cache for port 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG nova.network.neutron [req-48a5bb70-051d-4fd9-b2a4-d0e15964d064 req-de603d3e-fe5e-44df-8106-722f475f273a service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating instance_info_cache with network_info: [{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:16 user nova-compute[73067]: INFO nova.compute.manager [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Attaching volume 20106068-d17b-41d4-84b5-3196972e2787 to /dev/vdb
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-48a5bb70-051d-4fd9-b2a4-d0e15964d064 req-de603d3e-fe5e-44df-8106-722f475f273a service nova] Releasing lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG os_brick.utils [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff802972-b1a5-4373-8101-f48ee3e0c761]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dec241-e59f-46df-a0a6-f17bac4ae8e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cc2230-4ad1-4334-8614-ccbf07f726cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b18c71-5de7-487b-a59b-7f0228255cb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:49:16 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:49:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f805cb11-3cba-4783-a507-c8f3d13abfa4]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG os_brick.utils [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating existing volume attachment record: d1169837-49f1-40a8-baea-283fce634f17 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:49:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "81148494-4e85-478e-b9d9-b7d2ec270083" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:30 user nova-compute[73067]: INFO nova.compute.manager [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Unshelving
Aug 16 10:49:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:30 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'pci_requests' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:30 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'numa_topology' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:49:30 user nova-compute[73067]: INFO nova.compute.claims [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Claim successful on node user
Aug 16 10:49:30 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:49:30 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:49:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:30 user nova-compute[73067]: INFO nova.network.neutron [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updating port 2226e309-7e67-4ba4-a3df-27842a1bf141 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquired lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-dc1f0c85-8b13-4c97-9772-e8656a73500d req-0ca5872f-bd4d-4cef-b1cc-430f66217799 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-changed-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-dc1f0c85-8b13-4c97-9772-e8656a73500d req-0ca5872f-bd4d-4cef-b1cc-430f66217799 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Refreshing instance network info cache due to event network-changed-2226e309-7e67-4ba4-a3df-27842a1bf141. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dc1f0c85-8b13-4c97-9772-e8656a73500d req-0ca5872f-bd4d-4cef-b1cc-430f66217799 service nova] Acquiring lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updating instance_info_cache with network_info: [{"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Releasing lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:49:31 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Creating image(s)
Aug 16 10:49:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "/opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "/opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "/opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'trusted_certs' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dc1f0c85-8b13-4c97-9772-e8656a73500d req-0ca5872f-bd4d-4cef-b1cc-430f66217799 service nova] Acquired lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-dc1f0c85-8b13-4c97-9772-e8656a73500d req-0ca5872f-bd4d-4cef-b1cc-430f66217799 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Refreshing network info cache for port 2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "d9c5dc908e894c22594fcb0b8da45a8856fdbe58" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "d9c5dc908e894c22594fcb0b8da45a8856fdbe58" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58.part --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTxjhMAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:49:32 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:49:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:49:32 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:49:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:49:32 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d2b013-99be-4a52-a62d-342437ed53a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:49:32 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[222fc57e-75c3-4e43-a887-6cfa8293844b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787] added
Aug 16 10:49:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:32 user nova-compute[73067]: INFO nova.compute.manager [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Terminating instance
Aug 16 10:49:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d301d0-bf0a-4054-8437-0739fc80f121]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58.part --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG nova.virt.images [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] 495cc8b2-8342-4138-99ce-ae78a9778aeb was qcow2, converting to raw {{(pid=73067) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58.part /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58.converted {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[523e9186-8f87-4033-8eb3-fc3fa712829d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTxjhMAE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTxjhMAE" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7d2be3-b3fd-48ba-821c-8133ee68c3ed]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nTxjhMAE'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.055s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77792c1-2035-4a44-ad07-ce06e67dad0f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0167de-f2c0-4dff-9b27-06eaa4f31a8b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:49:33 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:49:33 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:49:33 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:49:33 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d78071-f6e9-4334-b376-f555be3e8800]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787, portal: 172.16.0.220,3260]
Aug 16 10:49:33 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787, portal: 172.16.0.220,3260] successful.
Aug 16 10:49:33 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[03128e25-d05a-41be-88b0-6c376f6d70b6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f01511-9c56-4765-b4c1-ac41e2d4043e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:49:33 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:49:33 user nova-compute[73067]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)
Aug 16 10:49:33 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:49:33 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:49:33 user nova-compute[73067]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)
Aug 16 10:49:33 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.490s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58.part /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58.converted" returned: 0 in 0.386s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58.converted --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddace40b-b24c-4a34-87a4-f18d1552bcb8]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTxjhMAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-5d5f2e65-1491-4169-bb59-9d217cc58b7d req-1ad9c9aa-ae41-408b-a5ce-cb16eb8c0d5b service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-vif-unplugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5d5f2e65-1491-4169-bb59-9d217cc58b7d req-1ad9c9aa-ae41-408b-a5ce-cb16eb8c0d5b service nova] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5d5f2e65-1491-4169-bb59-9d217cc58b7d req-1ad9c9aa-ae41-408b-a5ce-cb16eb8c0d5b service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5d5f2e65-1491-4169-bb59-9d217cc58b7d req-1ad9c9aa-ae41-408b-a5ce-cb16eb8c0d5b service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-5d5f2e65-1491-4169-bb59-9d217cc58b7d req-1ad9c9aa-ae41-408b-a5ce-cb16eb8c0d5b service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] No waiting events found dispatching network-vif-unplugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-5d5f2e65-1491-4169-bb59-9d217cc58b7d req-1ad9c9aa-ae41-408b-a5ce-cb16eb8c0d5b service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-vif-unplugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "d9c5dc908e894c22594fcb0b8da45a8856fdbe58" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.693s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-dc1f0c85-8b13-4c97-9772-e8656a73500d req-0ca5872f-bd4d-4cef-b1cc-430f66217799 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updated VIF entry in instance network info cache for port 2226e309-7e67-4ba4-a3df-27842a1bf141. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-dc1f0c85-8b13-4c97-9772-e8656a73500d req-0ca5872f-bd4d-4cef-b1cc-430f66217799 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updating instance_info_cache with network_info: [{"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dc1f0c85-8b13-4c97-9772-e8656a73500d req-0ca5872f-bd4d-4cef-b1cc-430f66217799 service nova] Releasing lock "refresh_cache-81148494-4e85-478e-b9d9-b7d2ec270083" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:49:33 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Instance destroyed successfully.
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'resources' on Instance uuid 3d166e9d-e05d-4378-b14b-0c10318490b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1700906205',display_name='tempest-TestMinimumBasicScenario-server-1700906205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1700906205',id=32,image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgkiw20ibEVvyBP1aNII5Kpem4blK8hbWaXd0J7BdzDTr8pVYG1tDfn0jp74MsRSRZcBd+VsmMI/mvuaAIiw2eow7xaOLfJKpYvP+OZtSK6g70MwoLrjfNaYzUkMxS8FA==',key_name='tempest-TestMinimumBasicScenario-1462671997',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd5f36d1e3e24603bf6832c3b46a2942',ramdisk_id='',reservation_id='r-wrcz371w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a41081d-c9ae-4543-be55-100c2e2697d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1702842771',owner_user_name='tempest-TestMinimumBasicScenario-1702842771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:46:47Z,user_data=None,user_id='61f8d65b293a41acb5aca991e2e41d57',uuid=3d166e9d-e05d-4378-b14b-0c10318490b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converting VIF {"id": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "address": "fa:16:3e:88:b8:d4", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be01f1-3a", "ovs_interfaceid": "22be01f1-3ab2-4867-a8f9-b1a050be6ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG os_vif [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22be01f1-3a, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:49:33 user nova-compute[73067]: INFO os_vif [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=22be01f1-3ab2-4867-a8f9-b1a050be6ff6,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be01f1-3a')
Aug 16 10:49:33 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Deleting instance files /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8_del
Aug 16 10:49:33 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Deletion of /opt/stack/data/nova/instances/3d166e9d-e05d-4378-b14b-0c10318490b8_del complete
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58 --force-share --output=json" returned: 0 in 0.210s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "d9c5dc908e894c22594fcb0b8da45a8856fdbe58" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "d9c5dc908e894c22594fcb0b8da45a8856fdbe58" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:33 user nova-compute[73067]: INFO nova.compute.manager [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58 --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:33 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58,backing_fmt=raw /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58,backing_fmt=raw /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk 1073741824" returned: 0 in 0.053s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "d9c5dc908e894c22594fcb0b8da45a8856fdbe58" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58 --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'migration_context' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Rebasing disk image.
Aug 16 10:49:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:49:34 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Took 0.52 seconds to deallocate network for instance.
Aug 16 10:49:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.596s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] <== connect_volume: return (1599ms) {'type': 'block', 'scsi_wwn': '26533663738646537', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533663738646537', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.194s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 -F raw /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG nova.objects.instance [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'flavor' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:49:34 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:49:34 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:49:34 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:49:34 user nova-compute[73067]:   <serial>20106068-d17b-41d4-84b5-3196972e2787</serial>
Aug 16 10:49:34 user nova-compute[73067]: </disk>
Aug 16 10:49:34 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:49:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:34 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Deleted allocations for instance 3d166e9d-e05d-4378-b14b-0c10318490b8
Aug 16 10:49:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:49:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:49:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No VIF found with MAC fa:16:3e:5e:10:35, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:49:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5519d6ea-f7a2-4f0d-99a4-2769c0b39103 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.195s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4b0adcd1-c60c-4620-ac65-6f61fd12e27c tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.730s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-b827da77-749d-4caa-9e7f-9cb6489d89d9 req-27ade06d-fd11-4d4f-9ce4-980db794944e service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b827da77-749d-4caa-9e7f-9cb6489d89d9 req-27ade06d-fd11-4d4f-9ce4-980db794944e service nova] Acquiring lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b827da77-749d-4caa-9e7f-9cb6489d89d9 req-27ade06d-fd11-4d4f-9ce4-980db794944e service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b827da77-749d-4caa-9e7f-9cb6489d89d9 req-27ade06d-fd11-4d4f-9ce4-980db794944e service nova] Lock "3d166e9d-e05d-4378-b14b-0c10318490b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-b827da77-749d-4caa-9e7f-9cb6489d89d9 req-27ade06d-fd11-4d4f-9ce4-980db794944e service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] No waiting events found dispatching network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:35 user nova-compute[73067]: WARNING nova.compute.manager [req-b827da77-749d-4caa-9e7f-9cb6489d89d9 req-27ade06d-fd11-4d4f-9ce4-980db794944e service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received unexpected event network-vif-plugged-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 for instance with vm_state deleted and task_state None.
Aug 16 10:49:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-b827da77-749d-4caa-9e7f-9cb6489d89d9 req-27ade06d-fd11-4d4f-9ce4-980db794944e service nova] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Received event network-vif-deleted-22be01f1-3ab2-4867-a8f9-b1a050be6ff6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:36 user nova-compute[73067]: INFO nova.compute.manager [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Rescuing
Aug 16 10:49:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquired lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 -F raw /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk" returned: 0 in 2.368s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Ensure instance console log exists: /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Start _get_guest_xml network_info=[{"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='026e2062a96506814bb62c6757433605',container_format='bare',created_at=2023-08-16T10:47:37Z,direct_url=<?>,disk_format='qcow2',id=495cc8b2-8342-4138-99ce-ae78a9778aeb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-940246306-shelved',owner='1390d54176cf46679a1d44d85aa20ba0',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-16T10:47:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:49:36 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:49:36 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='026e2062a96506814bb62c6757433605',container_format='bare',created_at=2023-08-16T10:47:37Z,direct_url=<?>,disk_format='qcow2',id=495cc8b2-8342-4138-99ce-ae78a9778aeb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-940246306-shelved',owner='1390d54176cf46679a1d44d85aa20ba0',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-16T10:47:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'vcpu_model' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-940246306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-940246306',id=34,image_ref='495cc8b2-8342-4138-99ce-ae78a9778aeb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2041136611',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:45:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-6f92xc37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member',shelved_at='2023-08-16T10:47:42.699499',shelved_host='user',shelved_image_id='495cc8b2-8342-4138-99ce-ae78a9778aeb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=81148494-4e85-478e-b9d9-b7d2ec270083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'pci_devices' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:49:36 user nova-compute[73067]:   <uuid>81148494-4e85-478e-b9d9-b7d2ec270083</uuid>
Aug 16 10:49:36 user nova-compute[73067]:   <name>instance-00000022</name>
Aug 16 10:49:36 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:49:36 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:49:36 user nova-compute[73067]:   <metadata>
Aug 16 10:49:36 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:49:36 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:49:36 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-940246306</nova:name>
Aug 16 10:49:36 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:49:36</nova:creationTime>
Aug 16 10:49:36 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:49:36 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:49:36 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:49:36 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:49:36 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:49:36 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:49:36 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:49:36 user nova-compute[73067]:       <nova:owner>
Aug 16 10:49:36 user nova-compute[73067]:         <nova:user uuid="220084fddd114ff989a0603bdb98df76">tempest-AttachVolumeShelveTestJSON-295458602-project-member</nova:user>
Aug 16 10:49:36 user nova-compute[73067]:         <nova:project uuid="1390d54176cf46679a1d44d85aa20ba0">tempest-AttachVolumeShelveTestJSON-295458602</nova:project>
Aug 16 10:49:36 user nova-compute[73067]:       </nova:owner>
Aug 16 10:49:36 user nova-compute[73067]:       <nova:root type="image" uuid="495cc8b2-8342-4138-99ce-ae78a9778aeb"/>
Aug 16 10:49:36 user nova-compute[73067]:       <nova:ports>
Aug 16 10:49:36 user nova-compute[73067]:         <nova:port uuid="2226e309-7e67-4ba4-a3df-27842a1bf141">
Aug 16 10:49:36 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 10:49:36 user nova-compute[73067]:         </nova:port>
Aug 16 10:49:36 user nova-compute[73067]:       </nova:ports>
Aug 16 10:49:36 user nova-compute[73067]:     </nova:instance>
Aug 16 10:49:36 user nova-compute[73067]:   </metadata>
Aug 16 10:49:36 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:49:36 user nova-compute[73067]:     <system>
Aug 16 10:49:36 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:49:36 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:49:36 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:49:36 user nova-compute[73067]:       <entry name="serial">81148494-4e85-478e-b9d9-b7d2ec270083</entry>
Aug 16 10:49:36 user nova-compute[73067]:       <entry name="uuid">81148494-4e85-478e-b9d9-b7d2ec270083</entry>
Aug 16 10:49:36 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:49:36 user nova-compute[73067]:     </system>
Aug 16 10:49:36 user nova-compute[73067]:   </sysinfo>
Aug 16 10:49:36 user nova-compute[73067]:   <os>
Aug 16 10:49:36 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:49:36 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:49:36 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:49:36 user nova-compute[73067]:   </os>
Aug 16 10:49:36 user nova-compute[73067]:   <features>
Aug 16 10:49:36 user nova-compute[73067]:     <acpi/>
Aug 16 10:49:36 user nova-compute[73067]:     <apic/>
Aug 16 10:49:36 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:49:36 user nova-compute[73067]:   </features>
Aug 16 10:49:36 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:49:36 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:49:36 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:49:36 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:49:36 user nova-compute[73067]:   </clock>
Aug 16 10:49:36 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:49:36 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:49:36 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:49:36 user nova-compute[73067]:   </cpu>
Aug 16 10:49:36 user nova-compute[73067]:   <devices>
Aug 16 10:49:36 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:49:36 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:49:36 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk"/>
Aug 16 10:49:36 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:49:36 user nova-compute[73067]:     </disk>
Aug 16 10:49:36 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:49:36 user nova-compute[73067]:       <mac address="fa:16:3e:1b:0b:2e"/>
Aug 16 10:49:36 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:49:36 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:49:36 user nova-compute[73067]:       <target dev="tap2226e309-7e"/>
Aug 16 10:49:36 user nova-compute[73067]:     </interface>
Aug 16 10:49:36 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:49:36 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/console.log" append="off"/>
Aug 16 10:49:36 user nova-compute[73067]:     </serial>
Aug 16 10:49:36 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:49:36 user nova-compute[73067]:     <video>
Aug 16 10:49:36 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:49:36 user nova-compute[73067]:     </video>
Aug 16 10:49:36 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:49:36 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:49:36 user nova-compute[73067]:     </rng>
Aug 16 10:49:36 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:49:36 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:49:36 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:49:36 user nova-compute[73067]:     </memballoon>
Aug 16 10:49:36 user nova-compute[73067]:   </devices>
Aug 16 10:49:36 user nova-compute[73067]: </domain>
Aug 16 10:49:36 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-940246306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-940246306',id=34,image_ref='495cc8b2-8342-4138-99ce-ae78a9778aeb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2041136611',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:45:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-6f92xc37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member',shelved_at='2023-08-16T10:47:42.699499',shelved_host='user',shelved_image_id='495cc8b2-8342-4138-99ce-ae78a9778aeb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=81148494-4e85-478e-b9d9-b7d2ec270083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG os_vif [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2226e309-7e, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2226e309-7e, col_values=(('external_ids', {'iface-id': '2226e309-7e67-4ba4-a3df-27842a1bf141', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:0b:2e', 'vm-uuid': '81148494-4e85-478e-b9d9-b7d2ec270083'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:49:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:36 user nova-compute[73067]: INFO os_vif [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e')
Aug 16 10:49:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] No VIF found with MAC fa:16:3e:1b:0b:2e, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG nova.network.neutron [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating instance_info_cache with network_info: [{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Releasing lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-fb8fce8a-748c-460b-bed4-0595929285fa req-1a90e053-c34d-409c-88a8-31fe8d359113 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-unplugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fb8fce8a-748c-460b-bed4-0595929285fa req-1a90e053-c34d-409c-88a8-31fe8d359113 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fb8fce8a-748c-460b-bed4-0595929285fa req-1a90e053-c34d-409c-88a8-31fe8d359113 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fb8fce8a-748c-460b-bed4-0595929285fa req-1a90e053-c34d-409c-88a8-31fe8d359113 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-fb8fce8a-748c-460b-bed4-0595929285fa req-1a90e053-c34d-409c-88a8-31fe8d359113 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-unplugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:37 user nova-compute[73067]: WARNING nova.compute.manager [req-fb8fce8a-748c-460b-bed4-0595929285fa req-1a90e053-c34d-409c-88a8-31fe8d359113 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-unplugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state active and task_state rescuing.
Aug 16 10:49:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Instance destroyed successfully.
Aug 16 10:49:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Attempting rescue
Aug 16 10:49:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73067) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Instance directory exists: not creating {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 10:49:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Creating image(s)
Aug 16 10:49:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG nova.objects.instance [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'trusted_certs' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue" returned: 0 in 0.062s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'migration_context' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Start _get_guest_xml network_info=[{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "vif_mac": "fa:16:3e:5e:10:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'resources' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'numa_topology' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:49:39 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'vcpu_model' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1416483222',display_name='tempest-ServerRescueNegativeTestJSON-server-1416483222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1416483222',id=36,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZSCPday0zZtusc90U09XkPuUHqs59FJETrkx7ouQ6+KGHxRpdJeNn8QWjhp0Bkq7FUM8fcLwe989pfZZ9m2BSSvZLbH1uTcIOtXCCyMKKmSIV+hjUiqEXg2HrIkg3OoA==',key_name='tempest-keypair-1950898086',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:47:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-0hu2g802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=58460bde-1b19-4ab9-b23a-5cae27a3b18b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "vif_mac": "fa:16:3e:5e:10:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "vif_mac": "fa:16:3e:5e:10:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:10:35,bridge_name='br-int',has_traffic_filtering=True,id=6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7f0f43-e4') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'pci_devices' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:49:39 user nova-compute[73067]:   <uuid>58460bde-1b19-4ab9-b23a-5cae27a3b18b</uuid>
Aug 16 10:49:39 user nova-compute[73067]:   <name>instance-00000024</name>
Aug 16 10:49:39 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:49:39 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:49:39 user nova-compute[73067]:   <metadata>
Aug 16 10:49:39 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:49:39 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:49:39 user nova-compute[73067]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1416483222</nova:name>
Aug 16 10:49:39 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:49:39</nova:creationTime>
Aug 16 10:49:39 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:49:39 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:49:39 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:49:39 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:49:39 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:49:39 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:49:39 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:49:39 user nova-compute[73067]:       <nova:owner>
Aug 16 10:49:39 user nova-compute[73067]:         <nova:user uuid="735a6aba3e974eb29e45ec3a7aa8c5cc">tempest-ServerRescueNegativeTestJSON-411494625-project-member</nova:user>
Aug 16 10:49:39 user nova-compute[73067]:         <nova:project uuid="687a889259b948fa985ce7c9b84b030a">tempest-ServerRescueNegativeTestJSON-411494625</nova:project>
Aug 16 10:49:39 user nova-compute[73067]:       </nova:owner>
Aug 16 10:49:39 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:49:39 user nova-compute[73067]:       <nova:ports>
Aug 16 10:49:39 user nova-compute[73067]:         <nova:port uuid="6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf">
Aug 16 10:49:39 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 10:49:39 user nova-compute[73067]:         </nova:port>
Aug 16 10:49:39 user nova-compute[73067]:       </nova:ports>
Aug 16 10:49:39 user nova-compute[73067]:     </nova:instance>
Aug 16 10:49:39 user nova-compute[73067]:   </metadata>
Aug 16 10:49:39 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:49:39 user nova-compute[73067]:     <system>
Aug 16 10:49:39 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:49:39 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:49:39 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:49:39 user nova-compute[73067]:       <entry name="serial">58460bde-1b19-4ab9-b23a-5cae27a3b18b</entry>
Aug 16 10:49:39 user nova-compute[73067]:       <entry name="uuid">58460bde-1b19-4ab9-b23a-5cae27a3b18b</entry>
Aug 16 10:49:39 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:49:39 user nova-compute[73067]:     </system>
Aug 16 10:49:39 user nova-compute[73067]:   </sysinfo>
Aug 16 10:49:39 user nova-compute[73067]:   <os>
Aug 16 10:49:39 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:49:39 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:49:39 user nova-compute[73067]:   </os>
Aug 16 10:49:39 user nova-compute[73067]:   <features>
Aug 16 10:49:39 user nova-compute[73067]:     <acpi/>
Aug 16 10:49:39 user nova-compute[73067]:     <apic/>
Aug 16 10:49:39 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:49:39 user nova-compute[73067]:   </features>
Aug 16 10:49:39 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:49:39 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:49:39 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:49:39 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:49:39 user nova-compute[73067]:   </clock>
Aug 16 10:49:39 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:49:39 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:49:39 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:49:39 user nova-compute[73067]:   </cpu>
Aug 16 10:49:39 user nova-compute[73067]:   <devices>
Aug 16 10:49:39 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:49:39 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:49:39 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue"/>
Aug 16 10:49:39 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:49:39 user nova-compute[73067]:     </disk>
Aug 16 10:49:39 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:49:39 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:49:39 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk"/>
Aug 16 10:49:39 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:49:39 user nova-compute[73067]:     </disk>
Aug 16 10:49:39 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:49:39 user nova-compute[73067]:       <mac address="fa:16:3e:5e:10:35"/>
Aug 16 10:49:39 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:49:39 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:49:39 user nova-compute[73067]:       <target dev="tap6a7f0f43-e4"/>
Aug 16 10:49:39 user nova-compute[73067]:     </interface>
Aug 16 10:49:39 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:49:39 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/console.log" append="off"/>
Aug 16 10:49:39 user nova-compute[73067]:     </serial>
Aug 16 10:49:39 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:49:39 user nova-compute[73067]:     <video>
Aug 16 10:49:39 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:49:39 user nova-compute[73067]:     </video>
Aug 16 10:49:39 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:49:39 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:49:39 user nova-compute[73067]:     </rng>
Aug 16 10:49:39 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:49:39 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:49:39 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:49:39 user nova-compute[73067]:     </memballoon>
Aug 16 10:49:39 user nova-compute[73067]:   </devices>
Aug 16 10:49:39 user nova-compute[73067]: </domain>
Aug 16 10:49:39 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:49:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Instance destroyed successfully.
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] No VIF found with MAC fa:16:3e:5e:10:35, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:39 user nova-compute[73067]: WARNING nova.compute.manager [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state active and task_state rescuing.
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] No waiting events found dispatching network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:39 user nova-compute[73067]: WARNING nova.compute.manager [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received unexpected event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] No waiting events found dispatching network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:39 user nova-compute[73067]: WARNING nova.compute.manager [req-d9f57cda-5062-4203-a6b7-c74e2c152ff3 req-e2f844a7-2e88-4b3e-a1ad-32360f6eb168 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received unexpected event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 10:49:40 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:49:40 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:49:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:40 user nova-compute[73067]: DEBUG nova.compute.manager [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:49:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:49:40 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182980.9761596, 81148494-4e85-478e-b9d9-b7d2ec270083 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:49:40 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] VM Resumed (Lifecycle Event)
Aug 16 10:49:40 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Instance spawned successfully.
Aug 16 10:49:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:49:41 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182980.9774277, 81148494-4e85-478e-b9d9-b7d2ec270083 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:49:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] VM Started (Lifecycle Event)
Aug 16 10:49:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:49:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3199aa4c-5f15-4034-9e79-98d40b38b20a tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "81148494-4e85-478e-b9d9-b7d2ec270083" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.291s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:42 user nova-compute[73067]: WARNING nova.compute.manager [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state active and task_state rescuing.
Aug 16 10:49:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:49:42 user nova-compute[73067]: WARNING nova.compute.manager [req-c54f1a6c-418f-439d-8940-045eb51dcd02 req-0afb11f7-8555-4163-aac4-10b3838f4856 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state active and task_state rescuing.
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for 58460bde-1b19-4ab9-b23a-5cae27a3b18b due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182983.084547, 58460bde-1b19-4ab9-b23a-5cae27a3b18b => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:49:43 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] VM Resumed (Lifecycle Event)
Aug 16 10:49:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-62dc8270-925f-4524-8887-0261429ede43 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:49:43 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 10:49:43 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692182983.0879827, 58460bde-1b19-4ab9-b23a-5cae27a3b18b => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:49:43 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] VM Started (Lifecycle Event)
Aug 16 10:49:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:49:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:49:45 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:49:45 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8052MB free_disk=24.858535766601562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf85594-1255-4383-b359-17ee78c71c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cd2f9cf3-f43d-40db-ada8-79c50589b1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 81148494-4e85-478e-b9d9-b7d2ec270083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:49:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:49:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:48 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692182973.7089012, 3d166e9d-e05d-4378-b14b-0c10318490b8 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:49:48 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] VM Stopped (Lifecycle Event)
Aug 16 10:49:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a932190e-8e8f-494d-9d40-52bb3f71e83d None None] [instance: 3d166e9d-e05d-4378-b14b-0c10318490b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:49:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:49:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:49:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:49:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:49:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 10:49:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:49:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:49:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:49:49 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:49:50 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updating instance_info_cache with network_info: [{"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:49:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:49:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:49:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:49:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:49:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:49:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:49:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:49:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:49:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:50:05 user nova-compute[73067]: INFO nova.compute.claims [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Claim successful on node user
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:50:05 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.policy [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddd560990aeb43b2baba0c299323db7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ae9395e3fe43ff9ca1f7cb0732f821', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:50:05 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Creating image(s)
Aug 16 10:50:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "/opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "/opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk 1073741824" returned: 0 in 0.138s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Successfully created port: 8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Cannot resize image /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'migration_context' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Ensure instance console log exists: /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:07 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Successfully updated port: 8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:50:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:50:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquired lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:50:07 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:50:07 user nova-compute[73067]: DEBUG nova.compute.manager [req-5cf8ac18-4335-468c-96ba-16acea3ba494 req-2c3ad038-da95-4202-b2ae-64de63d292f6 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-changed-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:50:07 user nova-compute[73067]: DEBUG nova.compute.manager [req-5cf8ac18-4335-468c-96ba-16acea3ba494 req-2c3ad038-da95-4202-b2ae-64de63d292f6 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Refreshing instance network info cache due to event network-changed-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:50:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5cf8ac18-4335-468c-96ba-16acea3ba494 req-2c3ad038-da95-4202-b2ae-64de63d292f6 service nova] Acquiring lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:50:07 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance_info_cache with network_info: [{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Releasing lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance network_info: |[{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5cf8ac18-4335-468c-96ba-16acea3ba494 req-2c3ad038-da95-4202-b2ae-64de63d292f6 service nova] Acquired lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.network.neutron [req-5cf8ac18-4335-468c-96ba-16acea3ba494 req-2c3ad038-da95-4202-b2ae-64de63d292f6 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Refreshing network info cache for port 8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Start _get_guest_xml network_info=[{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:50:08 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:50:08 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-463554452',display_name='tempest-ServerActionsTestOtherB-server-463554452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-463554452',id=37,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy8enApeRn5w4nXD7WPCVzzBNoEPkFBG9nJlwRN/7waOEDMxMNDNxlKwJIIiVsFfVgQ3mgGu5/NIf0JWVMMSGQeHLzR+u6ysEGCe+2qBYt2VQCEd8TlpcOSfKzUrbkTEA==',key_name='tempest-keypair-772909279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23ae9395e3fe43ff9ca1f7cb0732f821',ramdisk_id='',reservation_id='r-10kef8qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-462247235',owner_user_name='tempest-ServerActionsTestOtherB-462247235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd560990aeb43b2baba0c299323db7b',uuid=0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converting VIF {"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:50:08 user nova-compute[73067]:   <uuid>0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e</uuid>
Aug 16 10:50:08 user nova-compute[73067]:   <name>instance-00000025</name>
Aug 16 10:50:08 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:50:08 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:50:08 user nova-compute[73067]:   <metadata>
Aug 16 10:50:08 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:50:08 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:50:08 user nova-compute[73067]:       <nova:name>tempest-ServerActionsTestOtherB-server-463554452</nova:name>
Aug 16 10:50:08 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:50:08</nova:creationTime>
Aug 16 10:50:08 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:50:08 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:50:08 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:50:08 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:50:08 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:50:08 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:50:08 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:50:08 user nova-compute[73067]:       <nova:owner>
Aug 16 10:50:08 user nova-compute[73067]:         <nova:user uuid="ddd560990aeb43b2baba0c299323db7b">tempest-ServerActionsTestOtherB-462247235-project-member</nova:user>
Aug 16 10:50:08 user nova-compute[73067]:         <nova:project uuid="23ae9395e3fe43ff9ca1f7cb0732f821">tempest-ServerActionsTestOtherB-462247235</nova:project>
Aug 16 10:50:08 user nova-compute[73067]:       </nova:owner>
Aug 16 10:50:08 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:50:08 user nova-compute[73067]:       <nova:ports>
Aug 16 10:50:08 user nova-compute[73067]:         <nova:port uuid="8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb">
Aug 16 10:50:08 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 10:50:08 user nova-compute[73067]:         </nova:port>
Aug 16 10:50:08 user nova-compute[73067]:       </nova:ports>
Aug 16 10:50:08 user nova-compute[73067]:     </nova:instance>
Aug 16 10:50:08 user nova-compute[73067]:   </metadata>
Aug 16 10:50:08 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:50:08 user nova-compute[73067]:     <system>
Aug 16 10:50:08 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:50:08 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:50:08 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:50:08 user nova-compute[73067]:       <entry name="serial">0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e</entry>
Aug 16 10:50:08 user nova-compute[73067]:       <entry name="uuid">0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e</entry>
Aug 16 10:50:08 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:50:08 user nova-compute[73067]:     </system>
Aug 16 10:50:08 user nova-compute[73067]:   </sysinfo>
Aug 16 10:50:08 user nova-compute[73067]:   <os>
Aug 16 10:50:08 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:50:08 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:50:08 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:50:08 user nova-compute[73067]:   </os>
Aug 16 10:50:08 user nova-compute[73067]:   <features>
Aug 16 10:50:08 user nova-compute[73067]:     <acpi/>
Aug 16 10:50:08 user nova-compute[73067]:     <apic/>
Aug 16 10:50:08 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:50:08 user nova-compute[73067]:   </features>
Aug 16 10:50:08 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:50:08 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:50:08 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:50:08 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:50:08 user nova-compute[73067]:   </clock>
Aug 16 10:50:08 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:50:08 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:50:08 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:50:08 user nova-compute[73067]:   </cpu>
Aug 16 10:50:08 user nova-compute[73067]:   <devices>
Aug 16 10:50:08 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:50:08 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:50:08 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk"/>
Aug 16 10:50:08 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:50:08 user nova-compute[73067]:     </disk>
Aug 16 10:50:08 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:50:08 user nova-compute[73067]:       <mac address="fa:16:3e:43:1e:eb"/>
Aug 16 10:50:08 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:50:08 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:50:08 user nova-compute[73067]:       <target dev="tap8e8ac84e-9b"/>
Aug 16 10:50:08 user nova-compute[73067]:     </interface>
Aug 16 10:50:08 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:50:08 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/console.log" append="off"/>
Aug 16 10:50:08 user nova-compute[73067]:     </serial>
Aug 16 10:50:08 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:50:08 user nova-compute[73067]:     <video>
Aug 16 10:50:08 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:50:08 user nova-compute[73067]:     </video>
Aug 16 10:50:08 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:50:08 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:50:08 user nova-compute[73067]:     </rng>
Aug 16 10:50:08 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:50:08 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:50:08 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:50:08 user nova-compute[73067]:     </memballoon>
Aug 16 10:50:08 user nova-compute[73067]:   </devices>
Aug 16 10:50:08 user nova-compute[73067]: </domain>
Aug 16 10:50:08 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-463554452',display_name='tempest-ServerActionsTestOtherB-server-463554452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-463554452',id=37,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy8enApeRn5w4nXD7WPCVzzBNoEPkFBG9nJlwRN/7waOEDMxMNDNxlKwJIIiVsFfVgQ3mgGu5/NIf0JWVMMSGQeHLzR+u6ysEGCe+2qBYt2VQCEd8TlpcOSfKzUrbkTEA==',key_name='tempest-keypair-772909279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23ae9395e3fe43ff9ca1f7cb0732f821',ramdisk_id='',reservation_id='r-10kef8qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-462247235',owner_user_name='tempest-ServerActionsTestOtherB-462247235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd560990aeb43b2baba0c299323db7b',uuid=0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converting VIF {"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG os_vif [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e8ac84e-9b, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e8ac84e-9b, col_values=(('external_ids', {'iface-id': '8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:1e:eb', 'vm-uuid': '0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:08 user nova-compute[73067]: INFO os_vif [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b')
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] No VIF found with MAC fa:16:3e:43:1e:eb, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.network.neutron [req-5cf8ac18-4335-468c-96ba-16acea3ba494 req-2c3ad038-da95-4202-b2ae-64de63d292f6 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updated VIF entry in instance network info cache for port 8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG nova.network.neutron [req-5cf8ac18-4335-468c-96ba-16acea3ba494 req-2c3ad038-da95-4202-b2ae-64de63d292f6 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance_info_cache with network_info: [{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:50:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5cf8ac18-4335-468c-96ba-16acea3ba494 req-2c3ad038-da95-4202-b2ae-64de63d292f6 service nova] Releasing lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:50:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-e1644c63-a417-43c5-91e6-4c42e9674b56 req-5d1ea43b-e6a9-4ab3-902c-8615b8b80447 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:50:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e1644c63-a417-43c5-91e6-4c42e9674b56 req-5d1ea43b-e6a9-4ab3-902c-8615b8b80447 service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e1644c63-a417-43c5-91e6-4c42e9674b56 req-5d1ea43b-e6a9-4ab3-902c-8615b8b80447 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e1644c63-a417-43c5-91e6-4c42e9674b56 req-5d1ea43b-e6a9-4ab3-902c-8615b8b80447 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:09 user nova-compute[73067]: DEBUG nova.compute.manager [req-e1644c63-a417-43c5-91e6-4c42e9674b56 req-5d1ea43b-e6a9-4ab3-902c-8615b8b80447 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:50:09 user nova-compute[73067]: WARNING nova.compute.manager [req-e1644c63-a417-43c5-91e6-4c42e9674b56 req-5d1ea43b-e6a9-4ab3-902c-8615b8b80447 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state building and task_state spawning.
Aug 16 10:50:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183011.8953903, 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:50:11 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] VM Resumed (Lifecycle Event)
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:50:11 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance spawned successfully.
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:11 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183011.8970864, 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:50:11 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] VM Started (Lifecycle Event)
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-018adb8a-0c58-4279-80fd-4bef30497f71 req-6328e60a-4f89-4265-a330-6a4d6e11727e service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-018adb8a-0c58-4279-80fd-4bef30497f71 req-6328e60a-4f89-4265-a330-6a4d6e11727e service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-018adb8a-0c58-4279-80fd-4bef30497f71 req-6328e60a-4f89-4265-a330-6a4d6e11727e service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-018adb8a-0c58-4279-80fd-4bef30497f71 req-6328e60a-4f89-4265-a330-6a4d6e11727e service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-018adb8a-0c58-4279-80fd-4bef30497f71 req-6328e60a-4f89-4265-a330-6a4d6e11727e service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:50:11 user nova-compute[73067]: WARNING nova.compute.manager [req-018adb8a-0c58-4279-80fd-4bef30497f71 req-6328e60a-4f89-4265-a330-6a4d6e11727e service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state building and task_state spawning.
Aug 16 10:50:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:50:12 user nova-compute[73067]: INFO nova.compute.manager [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 16 10:50:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:50:12 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:50:12 user nova-compute[73067]: INFO nova.compute.manager [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Took 6.92 seconds to build instance.
Aug 16 10:50:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d09cf1b8-298a-4f8d-9250-3c6d7724306b tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.028s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:50:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:50:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:50:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:50:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:50:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:50:27 user nova-compute[73067]: INFO nova.compute.claims [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Claim successful on node user
Aug 16 10:50:28 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG nova.network.neutron [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:50:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:50:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG nova.policy [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61f8d65b293a41acb5aca991e2e41d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5f36d1e3e24603bf6832c3b46a2942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:50:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Creating image(s)
Aug 16 10:50:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "/opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "/opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "/opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "17cac0985e5636ec4f929f3577c4b91a1950a42b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "17cac0985e5636ec4f929f3577c4b91a1950a42b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b.part --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b.part --force-share --output=json" returned: 0 in 0.190s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:29 user nova-compute[73067]: DEBUG nova.virt.images [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] c2809392-21b8-4e9b-83d4-eac618a30960 was qcow2, converting to raw {{(pid=73067) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 10:50:29 user nova-compute[73067]: DEBUG nova.privsep.utils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73067) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 10:50:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b.part /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b.converted {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Successfully created port: 445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:50:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b.part /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b.converted" returned: 0 in 0.466s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b.converted --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "17cac0985e5636ec4f929f3577c4b91a1950a42b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.554s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "17cac0985e5636ec4f929f3577c4b91a1950a42b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "17cac0985e5636ec4f929f3577c4b91a1950a42b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.network.neutron [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Successfully updated port: 445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquired lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.network.neutron [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-1b2b17b4-8b88-461e-abb0-f0c27ae3790d req-ad87bf1a-daff-43a7-a681-7b24f66c1f8b service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-changed-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-1b2b17b4-8b88-461e-abb0-f0c27ae3790d req-ad87bf1a-daff-43a7-a681-7b24f66c1f8b service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Refreshing instance network info cache due to event network-changed-445ee6f3-c506-471f-a69e-b9b21d9fc7d3. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1b2b17b4-8b88-461e-abb0-f0c27ae3790d req-ad87bf1a-daff-43a7-a681-7b24f66c1f8b service nova] Acquiring lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b,backing_fmt=raw /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.network.neutron [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b,backing_fmt=raw /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk 1073741824" returned: 0 in 0.054s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "17cac0985e5636ec4f929f3577c4b91a1950a42b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.network.neutron [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updating instance_info_cache with network_info: [{"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Releasing lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Instance network_info: |[{"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1b2b17b4-8b88-461e-abb0-f0c27ae3790d req-ad87bf1a-daff-43a7-a681-7b24f66c1f8b service nova] Acquired lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.network.neutron [req-1b2b17b4-8b88-461e-abb0-f0c27ae3790d req-ad87bf1a-daff-43a7-a681-7b24f66c1f8b service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Refreshing network info cache for port 445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Cannot resize image /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.objects.instance [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'migration_context' on Instance uuid 5270141d-006f-4349-b919-ab3f1b395754 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Ensure instance console log exists: /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Start _get_guest_xml network_info=[{"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:50:24Z,direct_url=<?>,disk_format='qcow2',id=c2809392-21b8-4e9b-83d4-eac618a30960,min_disk=0,min_ram=0,name='tempest-scenario-img--441689796',owner='fd5f36d1e3e24603bf6832c3b46a2942',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:50:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'c2809392-21b8-4e9b-83d4-eac618a30960'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:50:30 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:50:30 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:50:24Z,direct_url=<?>,disk_format='qcow2',id=c2809392-21b8-4e9b-83d4-eac618a30960,min_disk=0,min_ram=0,name='tempest-scenario-img--441689796',owner='fd5f36d1e3e24603bf6832c3b46a2942',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:50:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1300160645',display_name='tempest-TestMinimumBasicScenario-server-1300160645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1300160645',id=38,image_ref='c2809392-21b8-4e9b-83d4-eac618a30960',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUXziBSGbvXdUn7iN6XtIurJBMKr+SypYAqVnz40uikeXUZV4yz7E+ezeQBdSGvHbkLIFcvKx4e1n+1zM4texgt4iiarq4wfq8RR0qkUBMDHjQRS0ngTdTUeAAvoW9T1A==',key_name='tempest-TestMinimumBasicScenario-17108840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd5f36d1e3e24603bf6832c3b46a2942',ramdisk_id='',reservation_id='r-zs1f06xq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c2809392-21b8-4e9b-83d4-eac618a30960',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1702842771',owner_user_name='tempest-TestMinimumBasicScenario-1702842771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:50:28Z,user_data=None,user_id='61f8d65b293a41acb5aca991e2e41d57',uuid=5270141d-006f-4349-b919-ab3f1b395754,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converting VIF {"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a6:f7,bridge_name='br-int',has_traffic_filtering=True,id=445ee6f3-c506-471f-a69e-b9b21d9fc7d3,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445ee6f3-c5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.objects.instance [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'pci_devices' on Instance uuid 5270141d-006f-4349-b919-ab3f1b395754 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:50:30 user nova-compute[73067]:   <uuid>5270141d-006f-4349-b919-ab3f1b395754</uuid>
Aug 16 10:50:30 user nova-compute[73067]:   <name>instance-00000026</name>
Aug 16 10:50:30 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:50:30 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:50:30 user nova-compute[73067]:   <metadata>
Aug 16 10:50:30 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:50:30 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:50:30 user nova-compute[73067]:       <nova:name>tempest-TestMinimumBasicScenario-server-1300160645</nova:name>
Aug 16 10:50:30 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:50:30</nova:creationTime>
Aug 16 10:50:30 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:50:30 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:50:30 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:50:30 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:50:30 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:50:30 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:50:30 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:50:30 user nova-compute[73067]:       <nova:owner>
Aug 16 10:50:30 user nova-compute[73067]:         <nova:user uuid="61f8d65b293a41acb5aca991e2e41d57">tempest-TestMinimumBasicScenario-1702842771-project-member</nova:user>
Aug 16 10:50:30 user nova-compute[73067]:         <nova:project uuid="fd5f36d1e3e24603bf6832c3b46a2942">tempest-TestMinimumBasicScenario-1702842771</nova:project>
Aug 16 10:50:30 user nova-compute[73067]:       </nova:owner>
Aug 16 10:50:30 user nova-compute[73067]:       <nova:root type="image" uuid="c2809392-21b8-4e9b-83d4-eac618a30960"/>
Aug 16 10:50:30 user nova-compute[73067]:       <nova:ports>
Aug 16 10:50:30 user nova-compute[73067]:         <nova:port uuid="445ee6f3-c506-471f-a69e-b9b21d9fc7d3">
Aug 16 10:50:30 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 10:50:30 user nova-compute[73067]:         </nova:port>
Aug 16 10:50:30 user nova-compute[73067]:       </nova:ports>
Aug 16 10:50:30 user nova-compute[73067]:     </nova:instance>
Aug 16 10:50:30 user nova-compute[73067]:   </metadata>
Aug 16 10:50:30 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:50:30 user nova-compute[73067]:     <system>
Aug 16 10:50:30 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:50:30 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:50:30 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:50:30 user nova-compute[73067]:       <entry name="serial">5270141d-006f-4349-b919-ab3f1b395754</entry>
Aug 16 10:50:30 user nova-compute[73067]:       <entry name="uuid">5270141d-006f-4349-b919-ab3f1b395754</entry>
Aug 16 10:50:30 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:50:30 user nova-compute[73067]:     </system>
Aug 16 10:50:30 user nova-compute[73067]:   </sysinfo>
Aug 16 10:50:30 user nova-compute[73067]:   <os>
Aug 16 10:50:30 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:50:30 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:50:30 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:50:30 user nova-compute[73067]:   </os>
Aug 16 10:50:30 user nova-compute[73067]:   <features>
Aug 16 10:50:30 user nova-compute[73067]:     <acpi/>
Aug 16 10:50:30 user nova-compute[73067]:     <apic/>
Aug 16 10:50:30 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:50:30 user nova-compute[73067]:   </features>
Aug 16 10:50:30 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:50:30 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:50:30 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:50:30 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:50:30 user nova-compute[73067]:   </clock>
Aug 16 10:50:30 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:50:30 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:50:30 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:50:30 user nova-compute[73067]:   </cpu>
Aug 16 10:50:30 user nova-compute[73067]:   <devices>
Aug 16 10:50:30 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:50:30 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:50:30 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk"/>
Aug 16 10:50:30 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:50:30 user nova-compute[73067]:     </disk>
Aug 16 10:50:30 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:50:30 user nova-compute[73067]:       <mac address="fa:16:3e:0f:a6:f7"/>
Aug 16 10:50:30 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:50:30 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:50:30 user nova-compute[73067]:       <target dev="tap445ee6f3-c5"/>
Aug 16 10:50:30 user nova-compute[73067]:     </interface>
Aug 16 10:50:30 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:50:30 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/console.log" append="off"/>
Aug 16 10:50:30 user nova-compute[73067]:     </serial>
Aug 16 10:50:30 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:50:30 user nova-compute[73067]:     <video>
Aug 16 10:50:30 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:50:30 user nova-compute[73067]:     </video>
Aug 16 10:50:30 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:50:30 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:50:30 user nova-compute[73067]:     </rng>
Aug 16 10:50:30 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:50:30 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:50:30 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:50:30 user nova-compute[73067]:     </memballoon>
Aug 16 10:50:30 user nova-compute[73067]:   </devices>
Aug 16 10:50:30 user nova-compute[73067]: </domain>
Aug 16 10:50:30 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1300160645',display_name='tempest-TestMinimumBasicScenario-server-1300160645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1300160645',id=38,image_ref='c2809392-21b8-4e9b-83d4-eac618a30960',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUXziBSGbvXdUn7iN6XtIurJBMKr+SypYAqVnz40uikeXUZV4yz7E+ezeQBdSGvHbkLIFcvKx4e1n+1zM4texgt4iiarq4wfq8RR0qkUBMDHjQRS0ngTdTUeAAvoW9T1A==',key_name='tempest-TestMinimumBasicScenario-17108840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd5f36d1e3e24603bf6832c3b46a2942',ramdisk_id='',reservation_id='r-zs1f06xq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c2809392-21b8-4e9b-83d4-eac618a30960',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1702842771',owner_user_name='tempest-TestMinimumBasicScenario-1702842771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:50:28Z,user_data=None,user_id='61f8d65b293a41acb5aca991e2e41d57',uuid=5270141d-006f-4349-b919-ab3f1b395754,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converting VIF {"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a6:f7,bridge_name='br-int',has_traffic_filtering=True,id=445ee6f3-c506-471f-a69e-b9b21d9fc7d3,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445ee6f3-c5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG os_vif [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a6:f7,bridge_name='br-int',has_traffic_filtering=True,id=445ee6f3-c506-471f-a69e-b9b21d9fc7d3,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445ee6f3-c5') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap445ee6f3-c5, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap445ee6f3-c5, col_values=(('external_ids', {'iface-id': '445ee6f3-c506-471f-a69e-b9b21d9fc7d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:a6:f7', 'vm-uuid': '5270141d-006f-4349-b919-ab3f1b395754'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:50:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:50:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:31 user nova-compute[73067]: INFO os_vif [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a6:f7,bridge_name='br-int',has_traffic_filtering=True,id=445ee6f3-c506-471f-a69e-b9b21d9fc7d3,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445ee6f3-c5')
Aug 16 10:50:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:50:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] No VIF found with MAC fa:16:3e:0f:a6:f7, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:50:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-1b2b17b4-8b88-461e-abb0-f0c27ae3790d req-ad87bf1a-daff-43a7-a681-7b24f66c1f8b service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updated VIF entry in instance network info cache for port 445ee6f3-c506-471f-a69e-b9b21d9fc7d3. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:50:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-1b2b17b4-8b88-461e-abb0-f0c27ae3790d req-ad87bf1a-daff-43a7-a681-7b24f66c1f8b service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updating instance_info_cache with network_info: [{"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:50:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1b2b17b4-8b88-461e-abb0-f0c27ae3790d req-ad87bf1a-daff-43a7-a681-7b24f66c1f8b service nova] Releasing lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:50:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-ac2a6ffc-7587-4374-a29a-f7f10f05d3ad req-3e02ef93-e75f-4d7f-a87f-4645a1df262c service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:50:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ac2a6ffc-7587-4374-a29a-f7f10f05d3ad req-3e02ef93-e75f-4d7f-a87f-4645a1df262c service nova] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ac2a6ffc-7587-4374-a29a-f7f10f05d3ad req-3e02ef93-e75f-4d7f-a87f-4645a1df262c service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ac2a6ffc-7587-4374-a29a-f7f10f05d3ad req-3e02ef93-e75f-4d7f-a87f-4645a1df262c service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-ac2a6ffc-7587-4374-a29a-f7f10f05d3ad req-3e02ef93-e75f-4d7f-a87f-4645a1df262c service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] No waiting events found dispatching network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:50:32 user nova-compute[73067]: WARNING nova.compute.manager [req-ac2a6ffc-7587-4374-a29a-f7f10f05d3ad req-3e02ef93-e75f-4d7f-a87f-4645a1df262c service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received unexpected event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 for instance with vm_state building and task_state spawning.
Aug 16 10:50:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-1dc87963-3d88-4ec2-9067-8e58824c2648 req-b8a0fd0f-a4c2-4f13-b755-5bacd410e673 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1dc87963-3d88-4ec2-9067-8e58824c2648 req-b8a0fd0f-a4c2-4f13-b755-5bacd410e673 service nova] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1dc87963-3d88-4ec2-9067-8e58824c2648 req-b8a0fd0f-a4c2-4f13-b755-5bacd410e673 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1dc87963-3d88-4ec2-9067-8e58824c2648 req-b8a0fd0f-a4c2-4f13-b755-5bacd410e673 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-1dc87963-3d88-4ec2-9067-8e58824c2648 req-b8a0fd0f-a4c2-4f13-b755-5bacd410e673 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] No waiting events found dispatching network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:50:34 user nova-compute[73067]: WARNING nova.compute.manager [req-1dc87963-3d88-4ec2-9067-8e58824c2648 req-b8a0fd0f-a4c2-4f13-b755-5bacd410e673 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received unexpected event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 for instance with vm_state building and task_state spawning.
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183034.6832051, 5270141d-006f-4349-b919-ab3f1b395754 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:50:34 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] VM Resumed (Lifecycle Event)
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:50:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Instance spawned successfully.
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:50:34 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183034.6840627, 5270141d-006f-4349-b919-ab3f1b395754 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:50:34 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] VM Started (Lifecycle Event)
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:50:34 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:50:34 user nova-compute[73067]: INFO nova.compute.manager [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Took 6.33 seconds to spawn the instance on the hypervisor.
Aug 16 10:50:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:50:34 user nova-compute[73067]: INFO nova.compute.manager [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Took 7.17 seconds to build instance.
Aug 16 10:50:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dba885f5-7260-4f05-afe1-53be26696c5c tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.280s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:40 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:40 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:40 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 10:50:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:50:46 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:50:46 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7697MB free_disk=24.87765121459961GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf85594-1255-4383-b359-17ee78c71c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cd2f9cf3-f43d-40db-ada8-79c50589b1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 81148494-4e85-478e-b9d9-b7d2ec270083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 5270141d-006f-4349-b919-ab3f1b395754 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:50:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:50:47 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:50:47 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:50:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:50:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updating instance_info_cache with network_info: [{"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-57c883ce-680f-455e-b393-e8c82576d440" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:50:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:50:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:50:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:52 user nova-compute[73067]: INFO nova.compute.manager [None req-1d00bbc3-9a9b-41c3-9331-fa7d519ab2b9 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Unrescuing
Aug 16 10:50:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1d00bbc3-9a9b-41c3-9331-fa7d519ab2b9 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:50:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1d00bbc3-9a9b-41c3-9331-fa7d519ab2b9 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquired lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:50:52 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1d00bbc3-9a9b-41c3-9331-fa7d519ab2b9 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG nova.network.neutron [None req-1d00bbc3-9a9b-41c3-9331-fa7d519ab2b9 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Updating instance_info_cache with network_info: [{"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1d00bbc3-9a9b-41c3-9331-fa7d519ab2b9 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Releasing lock "refresh_cache-cd2f9cf3-f43d-40db-ada8-79c50589b1b8" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG nova.objects.instance [None req-1d00bbc3-9a9b-41c3-9331-fa7d519ab2b9 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'flavor' on Instance uuid cd2f9cf3-f43d-40db-ada8-79c50589b1b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG nova.compute.manager [req-c9245fb5-4855-4b17-9d3d-955220025326 req-9d14a13a-9423-4fc3-ad2a-6cf45ef3e58c service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-unplugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c9245fb5-4855-4b17-9d3d-955220025326 req-9d14a13a-9423-4fc3-ad2a-6cf45ef3e58c service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c9245fb5-4855-4b17-9d3d-955220025326 req-9d14a13a-9423-4fc3-ad2a-6cf45ef3e58c service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c9245fb5-4855-4b17-9d3d-955220025326 req-9d14a13a-9423-4fc3-ad2a-6cf45ef3e58c service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:53 user nova-compute[73067]: DEBUG nova.compute.manager [req-c9245fb5-4855-4b17-9d3d-955220025326 req-9d14a13a-9423-4fc3-ad2a-6cf45ef3e58c service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-unplugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:50:53 user nova-compute[73067]: WARNING nova.compute.manager [req-c9245fb5-4855-4b17-9d3d-955220025326 req-9d14a13a-9423-4fc3-ad2a-6cf45ef3e58c service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-unplugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:50:54 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Instance destroyed successfully.
Aug 16 10:50:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:50:55 user nova-compute[73067]: WARNING nova.compute.manager [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:50:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:50:55 user nova-compute[73067]: WARNING nova.compute.manager [req-402419ee-9fff-4456-a10f-443f6ee7cfd1 req-3bb15ff6-b2df-4192-94d3-dcc67a2a44a8 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:50:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:50:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for cd2f9cf3-f43d-40db-ada8-79c50589b1b8 due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:50:57 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183057.7543216, cd2f9cf3-f43d-40db-ada8-79c50589b1b8 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:50:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] VM Resumed (Lifecycle Event)
Aug 16 10:50:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1d00bbc3-9a9b-41c3-9331-fa7d519ab2b9 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:50:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:50:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:50:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 10:50:57 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183057.7557883, cd2f9cf3-f43d-40db-ada8-79c50589b1b8 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:50:57 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] VM Started (Lifecycle Event)
Aug 16 10:50:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:50:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:50:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-75714597-391a-4a0d-9194-8ab5f072c752 req-e7121799-94a8-4b28-b4a5-e03fcd15b199 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:50:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-75714597-391a-4a0d-9194-8ab5f072c752 req-e7121799-94a8-4b28-b4a5-e03fcd15b199 service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:50:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-75714597-391a-4a0d-9194-8ab5f072c752 req-e7121799-94a8-4b28-b4a5-e03fcd15b199 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:50:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-75714597-391a-4a0d-9194-8ab5f072c752 req-e7121799-94a8-4b28-b4a5-e03fcd15b199 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:50:57 user nova-compute[73067]: DEBUG nova.compute.manager [req-75714597-391a-4a0d-9194-8ab5f072c752 req-e7121799-94a8-4b28-b4a5-e03fcd15b199 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:50:57 user nova-compute[73067]: WARNING nova.compute.manager [req-75714597-391a-4a0d-9194-8ab5f072c752 req-e7121799-94a8-4b28-b4a5-e03fcd15b199 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state active and task_state None.
Aug 16 10:51:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:07 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:07 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 10:51:07 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 10:51:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "81148494-4e85-478e-b9d9-b7d2ec270083" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:20 user nova-compute[73067]: INFO nova.compute.manager [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Terminating instance
Aug 16 10:51:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-a127eaca-f134-443e-b867-b5efc13e9392 req-196061de-7d37-40b7-aba1-51a2fd2dfb99 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-vif-unplugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a127eaca-f134-443e-b867-b5efc13e9392 req-196061de-7d37-40b7-aba1-51a2fd2dfb99 service nova] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a127eaca-f134-443e-b867-b5efc13e9392 req-196061de-7d37-40b7-aba1-51a2fd2dfb99 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a127eaca-f134-443e-b867-b5efc13e9392 req-196061de-7d37-40b7-aba1-51a2fd2dfb99 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-a127eaca-f134-443e-b867-b5efc13e9392 req-196061de-7d37-40b7-aba1-51a2fd2dfb99 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] No waiting events found dispatching network-vif-unplugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:51:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-a127eaca-f134-443e-b867-b5efc13e9392 req-196061de-7d37-40b7-aba1-51a2fd2dfb99 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-vif-unplugged-2226e309-7e67-4ba4-a3df-27842a1bf141 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:21 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Instance destroyed successfully.
Aug 16 10:51:21 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lazy-loading 'resources' on Instance uuid 81148494-4e85-478e-b9d9-b7d2ec270083 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T10:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-940246306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-940246306',id=34,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+91O5aNF1XQEIRXWT/CgrWWVYkU+RRbBxeoeHT7AGdkueqb+uDUk5nYhmGOkaA44PbqOC8BjjrqE2LB8+Hi1KY6P78qtk10ejD3KJKkb4ub1VxWRGubVB8Tn/P0bqEWg==',key_name='tempest-keypair-2041136611',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:49:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1390d54176cf46679a1d44d85aa20ba0',ramdisk_id='',reservation_id='r-6f92xc37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-295458602',owner_user_name='tempest-AttachVolumeShelveTestJSON-295458602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='220084fddd114ff989a0603bdb98df76',uuid=81148494-4e85-478e-b9d9-b7d2ec270083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converting VIF {"id": "2226e309-7e67-4ba4-a3df-27842a1bf141", "address": "fa:16:3e:1b:0b:2e", "network": {"id": "be866012-5599-4ebb-9b29-ffdc0de80fdd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2128297054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1390d54176cf46679a1d44d85aa20ba0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2226e309-7e", "ovs_interfaceid": "2226e309-7e67-4ba4-a3df-27842a1bf141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG os_vif [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2226e309-7e, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:51:21 user nova-compute[73067]: INFO os_vif [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0b:2e,bridge_name='br-int',has_traffic_filtering=True,id=2226e309-7e67-4ba4-a3df-27842a1bf141,network=Network(be866012-5599-4ebb-9b29-ffdc0de80fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2226e309-7e')
Aug 16 10:51:21 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Deleting instance files /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083_del
Aug 16 10:51:21 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Deletion of /opt/stack/data/nova/instances/81148494-4e85-478e-b9d9-b7d2ec270083_del complete
Aug 16 10:51:21 user nova-compute[73067]: INFO nova.compute.manager [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 10:51:21 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:51:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:51:22 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Took 0.92 seconds to deallocate network for instance.
Aug 16 10:51:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-d8eea5a3-f602-43f7-ae94-4df920a6db1c req-bbfac980-c858-4e89-8941-5305cebd1f23 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-vif-deleted-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:22 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Deleted allocations for instance 81148494-4e85-478e-b9d9-b7d2ec270083
Aug 16 10:51:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5f93bca5-ffc8-44f0-8d69-51a5b2d8b6fc tempest-AttachVolumeShelveTestJSON-295458602 tempest-AttachVolumeShelveTestJSON-295458602-project-member] Lock "81148494-4e85-478e-b9d9-b7d2ec270083" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.280s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-0fc46415-6fd1-4f63-8af6-ded6bd5792e5 req-de2cb904-8caf-42dd-91a5-99912d192608 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0fc46415-6fd1-4f63-8af6-ded6bd5792e5 req-de2cb904-8caf-42dd-91a5-99912d192608 service nova] Acquiring lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0fc46415-6fd1-4f63-8af6-ded6bd5792e5 req-de2cb904-8caf-42dd-91a5-99912d192608 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0fc46415-6fd1-4f63-8af6-ded6bd5792e5 req-de2cb904-8caf-42dd-91a5-99912d192608 service nova] Lock "81148494-4e85-478e-b9d9-b7d2ec270083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-0fc46415-6fd1-4f63-8af6-ded6bd5792e5 req-de2cb904-8caf-42dd-91a5-99912d192608 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] No waiting events found dispatching network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:51:22 user nova-compute[73067]: WARNING nova.compute.manager [req-0fc46415-6fd1-4f63-8af6-ded6bd5792e5 req-de2cb904-8caf-42dd-91a5-99912d192608 service nova] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Received unexpected event network-vif-plugged-2226e309-7e67-4ba4-a3df-27842a1bf141 for instance with vm_state deleted and task_state None.
Aug 16 10:51:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:28 user nova-compute[73067]: INFO nova.compute.manager [None req-c97268ac-f000-4ba1-8071-d81406dc63d6 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Unrescuing
Aug 16 10:51:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c97268ac-f000-4ba1-8071-d81406dc63d6 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:51:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c97268ac-f000-4ba1-8071-d81406dc63d6 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquired lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:51:28 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c97268ac-f000-4ba1-8071-d81406dc63d6 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c97268ac-f000-4ba1-8071-d81406dc63d6 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating instance_info_cache with network_info: [{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c97268ac-f000-4ba1-8071-d81406dc63d6 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Releasing lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG nova.objects.instance [None req-c97268ac-f000-4ba1-8071-d81406dc63d6 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'flavor' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-95eb2c51-5f12-4e21-ae68-c4bf1f1eefce req-e83e39f4-fefc-4e65-985c-6993dbb41fa3 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-unplugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-95eb2c51-5f12-4e21-ae68-c4bf1f1eefce req-e83e39f4-fefc-4e65-985c-6993dbb41fa3 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-95eb2c51-5f12-4e21-ae68-c4bf1f1eefce req-e83e39f4-fefc-4e65-985c-6993dbb41fa3 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-95eb2c51-5f12-4e21-ae68-c4bf1f1eefce req-e83e39f4-fefc-4e65-985c-6993dbb41fa3 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-95eb2c51-5f12-4e21-ae68-c4bf1f1eefce req-e83e39f4-fefc-4e65-985c-6993dbb41fa3 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-unplugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:51:29 user nova-compute[73067]: WARNING nova.compute.manager [req-95eb2c51-5f12-4e21-ae68-c4bf1f1eefce req-e83e39f4-fefc-4e65-985c-6993dbb41fa3 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-unplugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:51:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:29 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Instance destroyed successfully.
Aug 16 10:51:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:51:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:51:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:51:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:51:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:51:31 user nova-compute[73067]: WARNING nova.compute.manager [req-d116e90f-c00a-4e7d-8df4-e816cc9fa884 req-966527a1-6b40-4619-87ff-d0904e76d095 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state rescued and task_state unrescuing.
Aug 16 10:51:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for 58460bde-1b19-4ab9-b23a-5cae27a3b18b due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:51:33 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183093.1677673, 58460bde-1b19-4ab9-b23a-5cae27a3b18b => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:51:33 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] VM Resumed (Lifecycle Event)
Aug 16 10:51:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c97268ac-f000-4ba1-8071-d81406dc63d6 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:51:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:51:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:51:33 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 10:51:33 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183093.1694252, 58460bde-1b19-4ab9-b23a-5cae27a3b18b => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:51:33 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] VM Started (Lifecycle Event)
Aug 16 10:51:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:51:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:51:36 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183081.0285337, 81148494-4e85-478e-b9d9-b7d2ec270083 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:51:36 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] VM Stopped (Lifecycle Event)
Aug 16 10:51:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-845889c8-a1e4-4205-9e1a-f80b29673903 None None] [instance: 81148494-4e85-478e-b9d9-b7d2ec270083] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:51:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:51:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:51:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:51:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:51:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:51:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:51:46 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:51:46 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:51:46 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7771MB free_disk=24.876022338867188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:51:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:51:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf85594-1255-4383-b359-17ee78c71c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cd2f9cf3-f43d-40db-ada8-79c50589b1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 5270141d-006f-4349-b919-ab3f1b395754 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:51:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:51:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:51:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:51:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:51:49 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:51:50 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updating instance_info_cache with network_info: [{"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:51:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:51:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:51:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:51:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:51:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:51:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-6d4cf349-c6a9-4629-835a-e69b93de55d2 req-d10966d1-6f6a-4694-bc35-f78ecc424d14 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-changed-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:51:56 user nova-compute[73067]: DEBUG nova.compute.manager [req-6d4cf349-c6a9-4629-835a-e69b93de55d2 req-d10966d1-6f6a-4694-bc35-f78ecc424d14 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Refreshing instance network info cache due to event network-changed-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:51:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6d4cf349-c6a9-4629-835a-e69b93de55d2 req-d10966d1-6f6a-4694-bc35-f78ecc424d14 service nova] Acquiring lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:51:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6d4cf349-c6a9-4629-835a-e69b93de55d2 req-d10966d1-6f6a-4694-bc35-f78ecc424d14 service nova] Acquired lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:51:56 user nova-compute[73067]: DEBUG nova.network.neutron [req-6d4cf349-c6a9-4629-835a-e69b93de55d2 req-d10966d1-6f6a-4694-bc35-f78ecc424d14 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Refreshing network info cache for port 8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:51:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:51:56 user nova-compute[73067]: DEBUG nova.network.neutron [req-6d4cf349-c6a9-4629-835a-e69b93de55d2 req-d10966d1-6f6a-4694-bc35-f78ecc424d14 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updated VIF entry in instance network info cache for port 8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:51:56 user nova-compute[73067]: DEBUG nova.network.neutron [req-6d4cf349-c6a9-4629-835a-e69b93de55d2 req-d10966d1-6f6a-4694-bc35-f78ecc424d14 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance_info_cache with network_info: [{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:51:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6d4cf349-c6a9-4629-835a-e69b93de55d2 req-d10966d1-6f6a-4694-bc35-f78ecc424d14 service nova] Releasing lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:52:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG nova.objects.instance [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'flavor' on Instance uuid 5270141d-006f-4349-b919-ab3f1b395754 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:22 user nova-compute[73067]: INFO nova.compute.manager [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Attaching volume bac75f5e-d759-4e95-b73e-e90ceb6a903c to /dev/vdb
Aug 16 10:52:22 user nova-compute[73067]: DEBUG os_brick.utils [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdde37e-e0f8-4e51-a11f-ffcaf726e39a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e4aa6c-75b7-470c-91a0-db4800d44c12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c54aa5-099f-469d-97aa-8cae6aeac543]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c098a32a-3879-4f4e-8163-bdfab08dae95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:52:22 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:52:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47299eb-adfb-4f7e-a76b-ef2986fc92ba]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG os_brick.utils [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:52:22 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updating existing volume attachment record: f5d1b5fb-a21f-45bf-b565-8b2df0801ecf {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:52:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:24 user nova-compute[73067]: DEBUG nova.compute.manager [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:52:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:24 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:52:24 user nova-compute[73067]: INFO nova.compute.claims [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Claim successful on node user
Aug 16 10:52:25 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG nova.network.neutron [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:52:25 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:52:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG nova.policy [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3bc17160eb542d7bdf352de868da8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf55c7e83e8401ba10efb3d6bcf234a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:52:25 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Creating image(s)
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "/opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "/opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "/opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk 1073741824" returned: 0 in 0.068s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:25 user nova-compute[73067]: DEBUG nova.network.neutron [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Successfully created port: 95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Cannot resize image /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG nova.objects.instance [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lazy-loading 'migration_context' on Instance uuid f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Ensure instance console log exists: /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Successfully updated port: 95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "refresh_cache-f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquired lock "refresh_cache-f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-60fd492c-117b-4c66-a174-c449aab2c9f8 req-d20c5af7-a27b-4532-aea5-87c6a6b25822 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received event network-changed-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-60fd492c-117b-4c66-a174-c449aab2c9f8 req-d20c5af7-a27b-4532-aea5-87c6a6b25822 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Refreshing instance network info cache due to event network-changed-95accca5-a977-4d47-964f-57e8451d9cfb. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-60fd492c-117b-4c66-a174-c449aab2c9f8 req-d20c5af7-a27b-4532-aea5-87c6a6b25822 service nova] Acquiring lock "refresh_cache-f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Updating instance_info_cache with network_info: [{"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Releasing lock "refresh_cache-f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Instance network_info: |[{"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-60fd492c-117b-4c66-a174-c449aab2c9f8 req-d20c5af7-a27b-4532-aea5-87c6a6b25822 service nova] Acquired lock "refresh_cache-f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.neutron [req-60fd492c-117b-4c66-a174-c449aab2c9f8 req-d20c5af7-a27b-4532-aea5-87c6a6b25822 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Refreshing network info cache for port 95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Start _get_guest_xml network_info=[{"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:52:27 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:52:27 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1284292008',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1284292008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1284292',id=39,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4ibWyM6ZeKoLVeRNwk7nH6lFTgdMRkgVuzYTOQ2RreGeEJHFwENwoDi3iKX42nzR+rwfRPo+e0BbA+aJ8FNjxrs3VJwa/rDnWLS1Om6tJ9BVdeVv8YBSN962wBqzOefw==',key_name='tempest-keypair-1944730387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cf55c7e83e8401ba10efb3d6bcf234a',ramdisk_id='',reservation_id='r-qqzvrotj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-653345736',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:52:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3bc17160eb542d7bdf352de868da8ab',uuid=f00a4fba-26b6-4f2f-85d7-fc4e4423edb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Converting VIF {"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:c1:d5,bridge_name='br-int',has_traffic_filtering=True,id=95accca5-a977-4d47-964f-57e8451d9cfb,network=Network(fe72448a-4153-4dd3-8ff1-68a86b2d6258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95accca5-a9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.objects.instance [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lazy-loading 'pci_devices' on Instance uuid f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:52:27 user nova-compute[73067]:   <uuid>f00a4fba-26b6-4f2f-85d7-fc4e4423edb1</uuid>
Aug 16 10:52:27 user nova-compute[73067]:   <name>instance-00000027</name>
Aug 16 10:52:27 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:52:27 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:52:27 user nova-compute[73067]:   <metadata>
Aug 16 10:52:27 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:52:27 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:52:27 user nova-compute[73067]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1284292008</nova:name>
Aug 16 10:52:27 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:52:27</nova:creationTime>
Aug 16 10:52:27 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:52:27 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:52:27 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:52:27 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:52:27 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:52:27 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:52:27 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:52:27 user nova-compute[73067]:       <nova:owner>
Aug 16 10:52:27 user nova-compute[73067]:         <nova:user uuid="e3bc17160eb542d7bdf352de868da8ab">tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member</nova:user>
Aug 16 10:52:27 user nova-compute[73067]:         <nova:project uuid="4cf55c7e83e8401ba10efb3d6bcf234a">tempest-TestServerVolumeAttachScenarioOldVersion-653345736</nova:project>
Aug 16 10:52:27 user nova-compute[73067]:       </nova:owner>
Aug 16 10:52:27 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:52:27 user nova-compute[73067]:       <nova:ports>
Aug 16 10:52:27 user nova-compute[73067]:         <nova:port uuid="95accca5-a977-4d47-964f-57e8451d9cfb">
Aug 16 10:52:27 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 10:52:27 user nova-compute[73067]:         </nova:port>
Aug 16 10:52:27 user nova-compute[73067]:       </nova:ports>
Aug 16 10:52:27 user nova-compute[73067]:     </nova:instance>
Aug 16 10:52:27 user nova-compute[73067]:   </metadata>
Aug 16 10:52:27 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:52:27 user nova-compute[73067]:     <system>
Aug 16 10:52:27 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:52:27 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:52:27 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:52:27 user nova-compute[73067]:       <entry name="serial">f00a4fba-26b6-4f2f-85d7-fc4e4423edb1</entry>
Aug 16 10:52:27 user nova-compute[73067]:       <entry name="uuid">f00a4fba-26b6-4f2f-85d7-fc4e4423edb1</entry>
Aug 16 10:52:27 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:52:27 user nova-compute[73067]:     </system>
Aug 16 10:52:27 user nova-compute[73067]:   </sysinfo>
Aug 16 10:52:27 user nova-compute[73067]:   <os>
Aug 16 10:52:27 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:52:27 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:52:27 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:52:27 user nova-compute[73067]:   </os>
Aug 16 10:52:27 user nova-compute[73067]:   <features>
Aug 16 10:52:27 user nova-compute[73067]:     <acpi/>
Aug 16 10:52:27 user nova-compute[73067]:     <apic/>
Aug 16 10:52:27 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:52:27 user nova-compute[73067]:   </features>
Aug 16 10:52:27 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:52:27 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:52:27 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:52:27 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:52:27 user nova-compute[73067]:   </clock>
Aug 16 10:52:27 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:52:27 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:52:27 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:52:27 user nova-compute[73067]:   </cpu>
Aug 16 10:52:27 user nova-compute[73067]:   <devices>
Aug 16 10:52:27 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:52:27 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:52:27 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk"/>
Aug 16 10:52:27 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:52:27 user nova-compute[73067]:     </disk>
Aug 16 10:52:27 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:52:27 user nova-compute[73067]:       <mac address="fa:16:3e:79:c1:d5"/>
Aug 16 10:52:27 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:52:27 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:52:27 user nova-compute[73067]:       <target dev="tap95accca5-a9"/>
Aug 16 10:52:27 user nova-compute[73067]:     </interface>
Aug 16 10:52:27 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:52:27 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/console.log" append="off"/>
Aug 16 10:52:27 user nova-compute[73067]:     </serial>
Aug 16 10:52:27 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:52:27 user nova-compute[73067]:     <video>
Aug 16 10:52:27 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:52:27 user nova-compute[73067]:     </video>
Aug 16 10:52:27 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:52:27 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:52:27 user nova-compute[73067]:     </rng>
Aug 16 10:52:27 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:52:27 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:52:27 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:52:27 user nova-compute[73067]:     </memballoon>
Aug 16 10:52:27 user nova-compute[73067]:   </devices>
Aug 16 10:52:27 user nova-compute[73067]: </domain>
Aug 16 10:52:27 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1284292008',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1284292008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1284292',id=39,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4ibWyM6ZeKoLVeRNwk7nH6lFTgdMRkgVuzYTOQ2RreGeEJHFwENwoDi3iKX42nzR+rwfRPo+e0BbA+aJ8FNjxrs3VJwa/rDnWLS1Om6tJ9BVdeVv8YBSN962wBqzOefw==',key_name='tempest-keypair-1944730387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cf55c7e83e8401ba10efb3d6bcf234a',ramdisk_id='',reservation_id='r-qqzvrotj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-653345736',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:52:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3bc17160eb542d7bdf352de868da8ab',uuid=f00a4fba-26b6-4f2f-85d7-fc4e4423edb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Converting VIF {"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:c1:d5,bridge_name='br-int',has_traffic_filtering=True,id=95accca5-a977-4d47-964f-57e8451d9cfb,network=Network(fe72448a-4153-4dd3-8ff1-68a86b2d6258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95accca5-a9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG os_vif [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:c1:d5,bridge_name='br-int',has_traffic_filtering=True,id=95accca5-a977-4d47-964f-57e8451d9cfb,network=Network(fe72448a-4153-4dd3-8ff1-68a86b2d6258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95accca5-a9') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95accca5-a9, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95accca5-a9, col_values=(('external_ids', {'iface-id': '95accca5-a977-4d47-964f-57e8451d9cfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:c1:d5', 'vm-uuid': 'f00a4fba-26b6-4f2f-85d7-fc4e4423edb1'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:27 user nova-compute[73067]: INFO os_vif [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:c1:d5,bridge_name='br-int',has_traffic_filtering=True,id=95accca5-a977-4d47-964f-57e8451d9cfb,network=Network(fe72448a-4153-4dd3-8ff1-68a86b2d6258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95accca5-a9')
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] No VIF found with MAC fa:16:3e:79:c1:d5, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.neutron [req-60fd492c-117b-4c66-a174-c449aab2c9f8 req-d20c5af7-a27b-4532-aea5-87c6a6b25822 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Updated VIF entry in instance network info cache for port 95accca5-a977-4d47-964f-57e8451d9cfb. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG nova.network.neutron [req-60fd492c-117b-4c66-a174-c449aab2c9f8 req-d20c5af7-a27b-4532-aea5-87c6a6b25822 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Updating instance_info_cache with network_info: [{"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:52:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-60fd492c-117b-4c66-a174-c449aab2c9f8 req-d20c5af7-a27b-4532-aea5-87c6a6b25822 service nova] Releasing lock "refresh_cache-f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:52:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-2b527389-4e3e-488c-841d-bbe3a276b903 req-2e831afe-8c68-4504-a7b7-8fbbd29b4a5e service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received event network-vif-plugged-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2b527389-4e3e-488c-841d-bbe3a276b903 req-2e831afe-8c68-4504-a7b7-8fbbd29b4a5e service nova] Acquiring lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2b527389-4e3e-488c-841d-bbe3a276b903 req-2e831afe-8c68-4504-a7b7-8fbbd29b4a5e service nova] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2b527389-4e3e-488c-841d-bbe3a276b903 req-2e831afe-8c68-4504-a7b7-8fbbd29b4a5e service nova] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-2b527389-4e3e-488c-841d-bbe3a276b903 req-2e831afe-8c68-4504-a7b7-8fbbd29b4a5e service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] No waiting events found dispatching network-vif-plugged-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:52:29 user nova-compute[73067]: WARNING nova.compute.manager [req-2b527389-4e3e-488c-841d-bbe3a276b903 req-2e831afe-8c68-4504-a7b7-8fbbd29b4a5e service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received unexpected event network-vif-plugged-95accca5-a977-4d47-964f-57e8451d9cfb for instance with vm_state building and task_state spawning.
Aug 16 10:52:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183151.231907, f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:52:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] VM Resumed (Lifecycle Event)
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:52:31 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Instance spawned successfully.
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183151.2334976, f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:52:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] VM Started (Lifecycle Event)
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:52:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:52:31 user nova-compute[73067]: INFO nova.compute.manager [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-3eae61c6-e0b0-41ac-8e6e-a4bf8f3dca55 req-e9368012-4744-482a-8c50-bd33afa20709 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received event network-vif-plugged-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3eae61c6-e0b0-41ac-8e6e-a4bf8f3dca55 req-e9368012-4744-482a-8c50-bd33afa20709 service nova] Acquiring lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3eae61c6-e0b0-41ac-8e6e-a4bf8f3dca55 req-e9368012-4744-482a-8c50-bd33afa20709 service nova] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3eae61c6-e0b0-41ac-8e6e-a4bf8f3dca55 req-e9368012-4744-482a-8c50-bd33afa20709 service nova] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-3eae61c6-e0b0-41ac-8e6e-a4bf8f3dca55 req-e9368012-4744-482a-8c50-bd33afa20709 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] No waiting events found dispatching network-vif-plugged-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:52:31 user nova-compute[73067]: WARNING nova.compute.manager [req-3eae61c6-e0b0-41ac-8e6e-a4bf8f3dca55 req-e9368012-4744-482a-8c50-bd33afa20709 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received unexpected event network-vif-plugged-95accca5-a977-4d47-964f-57e8451d9cfb for instance with vm_state building and task_state spawning.
Aug 16 10:52:31 user nova-compute[73067]: INFO nova.compute.manager [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Took 6.71 seconds to build instance.
Aug 16 10:52:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-76922589-d4c1-42bd-af43-b5459f55ad4f tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.807s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puWOSCxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:52:36 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:52:36 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:52:36 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c3a412-3d9f-4b9e-8d55-4cbbaed2278f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:52:36 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f999ebf3-4f78-4987-bed4-7a0824276e41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c] added
Aug 16 10:52:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccc8f76-b970-4b0e-a753-b0b5e5cc1ac5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe172d5-7ba4-4a41-9d47-a61a7f07f1dc]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puWOSCxz {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puWOSCxz" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[177f07e4-32ad-4b1d-8d40-8e439f82b86a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'puWOSCxz'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85ecef0-691b-48d5-8753-ef2c27e5b1d4]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e816a5aa-623b-4f35-b9f3-2f739c37d71b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:52:36 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:52:36 user nova-compute[73067]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)
Aug 16 10:52:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:52:36 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:52:36 user nova-compute[73067]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)
Aug 16 10:52:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e624d49-ac0a-476e-96a2-4d3a3dd70e47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c, portal: 172.16.0.220,3260]
Aug 16 10:52:36 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c, portal: 172.16.0.220,3260] successful.
Aug 16 10:52:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c85f3b-76e5-4e0d-87f0-63ff4d963298]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9068f93-f3e8-40eb-adc9-39d16684af39]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:52:36 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:52:36 user nova-compute[73067]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)
Aug 16 10:52:36 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:52:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:52:36 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:52:36 user nova-compute[73067]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)
Aug 16 10:52:36 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:52:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6afd67-156e-46fc-8c5b-4c318c73f562]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:52:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:52:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puWOSCxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:52:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:52:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23836386533386638', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:52:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836386533386638', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:52:37 user nova-compute[73067]: DEBUG nova.objects.instance [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'flavor' on Instance uuid 5270141d-006f-4349-b919-ab3f1b395754 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:52:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:52:37 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:52:37 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:52:37 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:52:37 user nova-compute[73067]:   <serial>bac75f5e-d759-4e95-b73e-e90ceb6a903c</serial>
Aug 16 10:52:37 user nova-compute[73067]: </disk>
Aug 16 10:52:37 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:52:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:52:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:52:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] No VIF found with MAC fa:16:3e:0f:a6:f7, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:52:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4d76fa11-2f87-48f7-847c-94e9378e2166 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.777s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:40 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:52:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:40 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:52:40 user nova-compute[73067]: INFO nova.compute.claims [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Claim successful on node user
Aug 16 10:52:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-ab7a9194-4715-4e22-99c9-680327b62e61 req-5c67113b-05c6-434a-a80b-b511a50b653c service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-changed-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-ab7a9194-4715-4e22-99c9-680327b62e61 req-5c67113b-05c6-434a-a80b-b511a50b653c service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Refreshing instance network info cache due to event network-changed-445ee6f3-c506-471f-a69e-b9b21d9fc7d3. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:52:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ab7a9194-4715-4e22-99c9-680327b62e61 req-5c67113b-05c6-434a-a80b-b511a50b653c service nova] Acquiring lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:52:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ab7a9194-4715-4e22-99c9-680327b62e61 req-5c67113b-05c6-434a-a80b-b511a50b653c service nova] Acquired lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:52:40 user nova-compute[73067]: DEBUG nova.network.neutron [req-ab7a9194-4715-4e22-99c9-680327b62e61 req-5c67113b-05c6-434a-a80b-b511a50b653c service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Refreshing network info cache for port 445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.network.neutron [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:52:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.policy [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b01dc15c8fa4a569b697670f32f203a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bab7d6d47c14ddc9cfda43e4cf715e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:52:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Creating image(s)
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "/opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "/opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.network.neutron [req-ab7a9194-4715-4e22-99c9-680327b62e61 req-5c67113b-05c6-434a-a80b-b511a50b653c service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updated VIF entry in instance network info cache for port 445ee6f3-c506-471f-a69e-b9b21d9fc7d3. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG nova.network.neutron [req-ab7a9194-4715-4e22-99c9-680327b62e61 req-5c67113b-05c6-434a-a80b-b511a50b653c service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updating instance_info_cache with network_info: [{"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ab7a9194-4715-4e22-99c9-680327b62e61 req-5c67113b-05c6-434a-a80b-b511a50b653c service nova] Releasing lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk 1073741824" returned: 0 in 0.057s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG nova.network.neutron [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Successfully created port: 213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Cannot resize image /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'migration_context' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Ensure instance console log exists: /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG nova.network.neutron [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Successfully updated port: 213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquired lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG nova.network.neutron [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-717074c1-de17-4bbb-8473-aa95a27ea934 req-a4526ca8-074c-4d77-bd00-1abb30f0e1e2 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-changed-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-717074c1-de17-4bbb-8473-aa95a27ea934 req-a4526ca8-074c-4d77-bd00-1abb30f0e1e2 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Refreshing instance network info cache due to event network-changed-213380a9-db5d-43fa-9330-72618ec45a34. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:52:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-717074c1-de17-4bbb-8473-aa95a27ea934 req-a4526ca8-074c-4d77-bd00-1abb30f0e1e2 service nova] Acquiring lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-4af04058-5d23-4390-a92b-81ce12d619de req-60365a59-42d0-4711-9d1c-4475440db000 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-changed-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-4af04058-5d23-4390-a92b-81ce12d619de req-60365a59-42d0-4711-9d1c-4475440db000 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Refreshing instance network info cache due to event network-changed-445ee6f3-c506-471f-a69e-b9b21d9fc7d3. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4af04058-5d23-4390-a92b-81ce12d619de req-60365a59-42d0-4711-9d1c-4475440db000 service nova] Acquiring lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4af04058-5d23-4390-a92b-81ce12d619de req-60365a59-42d0-4711-9d1c-4475440db000 service nova] Acquired lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.neutron [req-4af04058-5d23-4390-a92b-81ce12d619de req-60365a59-42d0-4711-9d1c-4475440db000 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Refreshing network info cache for port 445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.neutron [req-4af04058-5d23-4390-a92b-81ce12d619de req-60365a59-42d0-4711-9d1c-4475440db000 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updated VIF entry in instance network info cache for port 445ee6f3-c506-471f-a69e-b9b21d9fc7d3. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.neutron [req-4af04058-5d23-4390-a92b-81ce12d619de req-60365a59-42d0-4711-9d1c-4475440db000 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updating instance_info_cache with network_info: [{"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4af04058-5d23-4390-a92b-81ce12d619de req-60365a59-42d0-4711-9d1c-4475440db000 service nova] Releasing lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating instance_info_cache with network_info: [{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Releasing lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance network_info: |[{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-717074c1-de17-4bbb-8473-aa95a27ea934 req-a4526ca8-074c-4d77-bd00-1abb30f0e1e2 service nova] Acquired lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.neutron [req-717074c1-de17-4bbb-8473-aa95a27ea934 req-a4526ca8-074c-4d77-bd00-1abb30f0e1e2 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Refreshing network info cache for port 213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Start _get_guest_xml network_info=[{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:43 user nova-compute[73067]: INFO nova.compute.manager [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Rebooting instance
Aug 16 10:52:43 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:52:43 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931024664',display_name='tempest-AttachVolumeTestJSON-server-931024664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931024664',id=40,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwOi0yuhbB2aO510hkVHUD++zdxazhPibxi4KrFyYHibznqT8qcPp6KvP4Z430++DMtPTQKBwKnJl6IByJe4QNk+XSBH1FddohuifAEGgtG/fvgScji19DHLcSRW3nNxg==',key_name='tempest-keypair-725300935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-fk407c2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=e3815a53-0792-4d95-bb08-bb40cf42f1d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'pci_devices' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquired lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:52:43 user nova-compute[73067]:   <uuid>e3815a53-0792-4d95-bb08-bb40cf42f1d4</uuid>
Aug 16 10:52:43 user nova-compute[73067]:   <name>instance-00000028</name>
Aug 16 10:52:43 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:52:43 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:52:43 user nova-compute[73067]:   <metadata>
Aug 16 10:52:43 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:52:43 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:52:43 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeTestJSON-server-931024664</nova:name>
Aug 16 10:52:43 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:52:43</nova:creationTime>
Aug 16 10:52:43 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:52:43 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:52:43 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:52:43 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:52:43 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:52:43 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:52:43 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:52:43 user nova-compute[73067]:       <nova:owner>
Aug 16 10:52:43 user nova-compute[73067]:         <nova:user uuid="4b01dc15c8fa4a569b697670f32f203a">tempest-AttachVolumeTestJSON-1413526745-project-member</nova:user>
Aug 16 10:52:43 user nova-compute[73067]:         <nova:project uuid="6bab7d6d47c14ddc9cfda43e4cf715e5">tempest-AttachVolumeTestJSON-1413526745</nova:project>
Aug 16 10:52:43 user nova-compute[73067]:       </nova:owner>
Aug 16 10:52:43 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:52:43 user nova-compute[73067]:       <nova:ports>
Aug 16 10:52:43 user nova-compute[73067]:         <nova:port uuid="213380a9-db5d-43fa-9330-72618ec45a34">
Aug 16 10:52:43 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 10:52:43 user nova-compute[73067]:         </nova:port>
Aug 16 10:52:43 user nova-compute[73067]:       </nova:ports>
Aug 16 10:52:43 user nova-compute[73067]:     </nova:instance>
Aug 16 10:52:43 user nova-compute[73067]:   </metadata>
Aug 16 10:52:43 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:52:43 user nova-compute[73067]:     <system>
Aug 16 10:52:43 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:52:43 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:52:43 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:52:43 user nova-compute[73067]:       <entry name="serial">e3815a53-0792-4d95-bb08-bb40cf42f1d4</entry>
Aug 16 10:52:43 user nova-compute[73067]:       <entry name="uuid">e3815a53-0792-4d95-bb08-bb40cf42f1d4</entry>
Aug 16 10:52:43 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:52:43 user nova-compute[73067]:     </system>
Aug 16 10:52:43 user nova-compute[73067]:   </sysinfo>
Aug 16 10:52:43 user nova-compute[73067]:   <os>
Aug 16 10:52:43 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:52:43 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:52:43 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:52:43 user nova-compute[73067]:   </os>
Aug 16 10:52:43 user nova-compute[73067]:   <features>
Aug 16 10:52:43 user nova-compute[73067]:     <acpi/>
Aug 16 10:52:43 user nova-compute[73067]:     <apic/>
Aug 16 10:52:43 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:52:43 user nova-compute[73067]:   </features>
Aug 16 10:52:43 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:52:43 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:52:43 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:52:43 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:52:43 user nova-compute[73067]:   </clock>
Aug 16 10:52:43 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:52:43 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:52:43 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:52:43 user nova-compute[73067]:   </cpu>
Aug 16 10:52:43 user nova-compute[73067]:   <devices>
Aug 16 10:52:43 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:52:43 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:52:43 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk"/>
Aug 16 10:52:43 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:52:43 user nova-compute[73067]:     </disk>
Aug 16 10:52:43 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:52:43 user nova-compute[73067]:       <mac address="fa:16:3e:f5:ee:ed"/>
Aug 16 10:52:43 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:52:43 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:52:43 user nova-compute[73067]:       <target dev="tap213380a9-db"/>
Aug 16 10:52:43 user nova-compute[73067]:     </interface>
Aug 16 10:52:43 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:52:43 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/console.log" append="off"/>
Aug 16 10:52:43 user nova-compute[73067]:     </serial>
Aug 16 10:52:43 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:52:43 user nova-compute[73067]:     <video>
Aug 16 10:52:43 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:52:43 user nova-compute[73067]:     </video>
Aug 16 10:52:43 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:52:43 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:52:43 user nova-compute[73067]:     </rng>
Aug 16 10:52:43 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:52:43 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:52:43 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:52:43 user nova-compute[73067]:     </memballoon>
Aug 16 10:52:43 user nova-compute[73067]:   </devices>
Aug 16 10:52:43 user nova-compute[73067]: </domain>
Aug 16 10:52:43 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931024664',display_name='tempest-AttachVolumeTestJSON-server-931024664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931024664',id=40,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwOi0yuhbB2aO510hkVHUD++zdxazhPibxi4KrFyYHibznqT8qcPp6KvP4Z430++DMtPTQKBwKnJl6IByJe4QNk+XSBH1FddohuifAEGgtG/fvgScji19DHLcSRW3nNxg==',key_name='tempest-keypair-725300935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-fk407c2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=e3815a53-0792-4d95-bb08-bb40cf42f1d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG os_vif [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap213380a9-db, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap213380a9-db, col_values=(('external_ids', {'iface-id': '213380a9-db5d-43fa-9330-72618ec45a34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ee:ed', 'vm-uuid': 'e3815a53-0792-4d95-bb08-bb40cf42f1d4'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:44 user nova-compute[73067]: INFO os_vif [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db')
Aug 16 10:52:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No VIF found with MAC fa:16:3e:f5:ee:ed, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:44 user nova-compute[73067]: INFO nova.compute.manager [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Terminating instance
Aug 16 10:52:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG nova.network.neutron [req-717074c1-de17-4bbb-8473-aa95a27ea934 req-a4526ca8-074c-4d77-bd00-1abb30f0e1e2 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updated VIF entry in instance network info cache for port 213380a9-db5d-43fa-9330-72618ec45a34. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG nova.network.neutron [req-717074c1-de17-4bbb-8473-aa95a27ea934 req-a4526ca8-074c-4d77-bd00-1abb30f0e1e2 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating instance_info_cache with network_info: [{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-717074c1-de17-4bbb-8473-aa95a27ea934 req-a4526ca8-074c-4d77-bd00-1abb30f0e1e2 service nova] Releasing lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-30ff4009-bccc-41a9-b32a-3f807106f82a req-629e7c0f-58ad-4198-8aff-8ffc2ead1bbf service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-unplugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-30ff4009-bccc-41a9-b32a-3f807106f82a req-629e7c0f-58ad-4198-8aff-8ffc2ead1bbf service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-30ff4009-bccc-41a9-b32a-3f807106f82a req-629e7c0f-58ad-4198-8aff-8ffc2ead1bbf service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-30ff4009-bccc-41a9-b32a-3f807106f82a req-629e7c0f-58ad-4198-8aff-8ffc2ead1bbf service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-30ff4009-bccc-41a9-b32a-3f807106f82a req-629e7c0f-58ad-4198-8aff-8ffc2ead1bbf service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-unplugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-30ff4009-bccc-41a9-b32a-3f807106f82a req-629e7c0f-58ad-4198-8aff-8ffc2ead1bbf service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-unplugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.network.neutron [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updating instance_info_cache with network_info: [{"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Releasing lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:45 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Instance destroyed successfully.
Aug 16 10:52:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.objects.instance [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'resources' on Instance uuid cd2f9cf3-f43d-40db-ada8-79c50589b1b8 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-346489190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-346489190',id=35,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-mjml73w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:50:58Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=cd2f9cf3-f43d-40db-ada8-79c50589b1b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "address": "fa:16:3e:22:de:d4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d5c6a-e5", "ovs_interfaceid": "494d5c6a-e5de-4fe9-b980-b0ac316cbb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:de:d4,bridge_name='br-int',has_traffic_filtering=True,id=494d5c6a-e5de-4fe9-b980-b0ac316cbb56,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d5c6a-e5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG os_vif [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:de:d4,bridge_name='br-int',has_traffic_filtering=True,id=494d5c6a-e5de-4fe9-b980-b0ac316cbb56,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d5c6a-e5') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap494d5c6a-e5, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:45 user nova-compute[73067]: INFO os_vif [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:de:d4,bridge_name='br-int',has_traffic_filtering=True,id=494d5c6a-e5de-4fe9-b980-b0ac316cbb56,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d5c6a-e5')
Aug 16 10:52:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhWvyqYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:52:45 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:52:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[946383d6-e5df-465a-8a16-144f7706fbb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca4f992-4f8e-435e-991a-464de8aa098e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:52:45 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:52:45 user nova-compute[73067]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)
Aug 16 10:52:45 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:52:45 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:52:45 user nova-compute[73067]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba (non-flash)
Aug 16 10:52:45 user nova-compute[73067]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)
Aug 16 10:52:45 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:52:45 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35841ce320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba'): ({'sdd'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Removing single pathed devices sdd {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ff168d-d027-4e61-a018-7d893098ebbe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.034s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54b397b-9a8f-4065-823c-1f2cae9757e4]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flushing IO for device /dev/sdd {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f7c472-d5a7-46d0-a056-270cccecac23]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d1f7ada-5673-46af-8daa-2c9f4632d587 req-ea05bcdb-b24f-4beb-8b71-59c65d8f2645 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d1f7ada-5673-46af-8daa-2c9f4632d587 req-ea05bcdb-b24f-4beb-8b71-59c65d8f2645 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d1f7ada-5673-46af-8daa-2c9f4632d587 req-ea05bcdb-b24f-4beb-8b71-59c65d8f2645 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d1f7ada-5673-46af-8daa-2c9f4632d587 req-ea05bcdb-b24f-4beb-8b71-59c65d8f2645 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d1f7ada-5673-46af-8daa-2c9f4632d587 req-ea05bcdb-b24f-4beb-8b71-59c65d8f2645 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:52:46 user nova-compute[73067]: WARNING nova.compute.manager [req-8d1f7ada-5673-46af-8daa-2c9f4632d587 req-ea05bcdb-b24f-4beb-8b71-59c65d8f2645 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state building and task_state spawning.
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f5de88-8d42-4f90-bf21-aa3b039dbb08]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9dac45-ae7a-4b24-840f-a2b2e9be5abc]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[673eb65b-03d9-4da1-a22a-4ac17cb986c6]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba, portal: 172.16.0.220,3260]
Aug 16 10:52:46 user nova-compute[73067]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba, portal: 172.16.0.220,3260] successful.
Aug 16 10:52:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d230b-3591-4cb2-b81a-b4988d120cba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aca79bc-fe02-4d43-9276-5a9ec3229cfe]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] <== disconnect_volume: return (446ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:52:46 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Deleting instance files /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8_del
Aug 16 10:52:46 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Deletion of /opt/stack/data/nova/instances/cd2f9cf3-f43d-40db-ada8-79c50589b1b8_del complete
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: INFO nova.compute.manager [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Took 2.19 seconds to destroy the instance on the hypervisor.
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:46 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:52:46 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Took 0.46 seconds to deallocate network for instance.
Aug 16 10:52:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-3996d8a4-51c4-4d66-a1d2-2288b096513d req-c4546651-8bab-4366-a3a6-977121263b87 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3996d8a4-51c4-4d66-a1d2-2288b096513d req-c4546651-8bab-4366-a3a6-977121263b87 service nova] Acquiring lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3996d8a4-51c4-4d66-a1d2-2288b096513d req-c4546651-8bab-4366-a3a6-977121263b87 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-3996d8a4-51c4-4d66-a1d2-2288b096513d req-c4546651-8bab-4366-a3a6-977121263b87 service nova] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-3996d8a4-51c4-4d66-a1d2-2288b096513d req-c4546651-8bab-4366-a3a6-977121263b87 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] No waiting events found dispatching network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:52:47 user nova-compute[73067]: WARNING nova.compute.manager [req-3996d8a4-51c4-4d66-a1d2-2288b096513d req-c4546651-8bab-4366-a3a6-977121263b87 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received unexpected event network-vif-plugged-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 for instance with vm_state active and task_state deleting.
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-3996d8a4-51c4-4d66-a1d2-2288b096513d req-c4546651-8bab-4366-a3a6-977121263b87 service nova] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Received event network-vif-deleted-494d5c6a-e5de-4fe9-b980-b0ac316cbb56 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:47 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:52:47 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7669MB free_disk=24.86227035522461GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-fa9f409a-4334-4342-ad97-4af295c7972a req-5af69331-9e45-4b08-8c16-e6ab6058dcb7 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-vif-unplugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fa9f409a-4334-4342-ad97-4af295c7972a req-5af69331-9e45-4b08-8c16-e6ab6058dcb7 service nova] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fa9f409a-4334-4342-ad97-4af295c7972a req-5af69331-9e45-4b08-8c16-e6ab6058dcb7 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fa9f409a-4334-4342-ad97-4af295c7972a req-5af69331-9e45-4b08-8c16-e6ab6058dcb7 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-fa9f409a-4334-4342-ad97-4af295c7972a req-5af69331-9e45-4b08-8c16-e6ab6058dcb7 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] No waiting events found dispatching network-vif-unplugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:52:47 user nova-compute[73067]: WARNING nova.compute.manager [req-fa9f409a-4334-4342-ad97-4af295c7972a req-5af69331-9e45-4b08-8c16-e6ab6058dcb7 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received unexpected event network-vif-unplugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 for instance with vm_state active and task_state reboot_started.
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 4bf85594-1255-4383-b359-17ee78c71c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance cd2f9cf3-f43d-40db-ada8-79c50589b1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 5270141d-006f-4349-b919-ab3f1b395754 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:52:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:52:47 user nova-compute[73067]: INFO nova.compute.manager [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Took 0.93 seconds to detach 1 volumes for instance.
Aug 16 10:52:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.215s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-bd7617c6-25b7-487d-8753-e72e765b70e0 req-4fb4eada-a153-41b4-b92f-7735a6bff341 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bd7617c6-25b7-487d-8753-e72e765b70e0 req-4fb4eada-a153-41b4-b92f-7735a6bff341 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bd7617c6-25b7-487d-8753-e72e765b70e0 req-4fb4eada-a153-41b4-b92f-7735a6bff341 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bd7617c6-25b7-487d-8753-e72e765b70e0 req-4fb4eada-a153-41b4-b92f-7735a6bff341 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-bd7617c6-25b7-487d-8753-e72e765b70e0 req-4fb4eada-a153-41b4-b92f-7735a6bff341 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:52:48 user nova-compute[73067]: WARNING nova.compute.manager [req-bd7617c6-25b7-487d-8753-e72e765b70e0 req-4fb4eada-a153-41b4-b92f-7735a6bff341 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state building and task_state spawning.
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183168.2479255, e3815a53-0792-4d95-bb08-bb40cf42f1d4 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:52:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] VM Resumed (Lifecycle Event)
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:52:48 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance spawned successfully.
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:52:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183168.249291, e3815a53-0792-4d95-bb08-bb40cf42f1d4 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:52:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] VM Started (Lifecycle Event)
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:52:48 user nova-compute[73067]: INFO nova.compute.manager [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Took 6.97 seconds to spawn the instance on the hypervisor.
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:52:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:52:48 user nova-compute[73067]: INFO nova.compute.manager [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Took 7.77 seconds to build instance.
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-2dba0b44-e407-4bcd-ba25-c35254317b76 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.880s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:52:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:48 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Deleted allocations for instance cd2f9cf3-f43d-40db-ada8-79c50589b1b8
Aug 16 10:52:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-062e6218-a427-40d7-8626-283e017d35dd tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "cd2f9cf3-f43d-40db-ada8-79c50589b1b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.370s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Instance shutdown successfully.
Aug 16 10:52:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-182b17a5-9dbe-4d2f-aead-c01f08a3aff2 req-3b2a1ec6-1c03-4f8c-bb95-363f6535213b service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-182b17a5-9dbe-4d2f-aead-c01f08a3aff2 req-3b2a1ec6-1c03-4f8c-bb95-363f6535213b service nova] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-182b17a5-9dbe-4d2f-aead-c01f08a3aff2 req-3b2a1ec6-1c03-4f8c-bb95-363f6535213b service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-182b17a5-9dbe-4d2f-aead-c01f08a3aff2 req-3b2a1ec6-1c03-4f8c-bb95-363f6535213b service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-182b17a5-9dbe-4d2f-aead-c01f08a3aff2 req-3b2a1ec6-1c03-4f8c-bb95-363f6535213b service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] No waiting events found dispatching network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:52:49 user nova-compute[73067]: WARNING nova.compute.manager [req-182b17a5-9dbe-4d2f-aead-c01f08a3aff2 req-3b2a1ec6-1c03-4f8c-bb95-363f6535213b service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received unexpected event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 for instance with vm_state active and task_state reboot_started.
Aug 16 10:52:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Updating instance_info_cache with network_info: [{"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] No waiting events found dispatching network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:52:51 user nova-compute[73067]: WARNING nova.compute.manager [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received unexpected event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 for instance with vm_state active and task_state reboot_started.
Aug 16 10:52:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] No waiting events found dispatching network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:52:51 user nova-compute[73067]: WARNING nova.compute.manager [req-6c12ba13-9686-4ffc-aafb-a5b3272d9616 req-48e0f9c3-4668-4efc-9448-58772c391087 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received unexpected event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 for instance with vm_state active and task_state reboot_started.
Aug 16 10:52:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:52:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:52:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Removed pending event for 5270141d-006f-4349-b919-ab3f1b395754 due to event {{(pid=73067) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 10:52:52 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183172.7871444, 5270141d-006f-4349-b919-ab3f1b395754 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:52:52 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] VM Resumed (Lifecycle Event)
Aug 16 10:52:52 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Instance running successfully.
Aug 16 10:52:52 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Instance soft rebooted successfully.
Aug 16 10:52:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:52:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:52:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:52:52 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 16 10:52:52 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183172.7886772, 5270141d-006f-4349-b919-ab3f1b395754 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:52:52 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] VM Started (Lifecycle Event)
Aug 16 10:52:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:52:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:52:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-722318de-26cb-44bb-9c8b-df2d73cb7895 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:52:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:52:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:52:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:00 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183165.8158264, cd2f9cf3-f43d-40db-ada8-79c50589b1b8 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:53:00 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] VM Stopped (Lifecycle Event)
Aug 16 10:53:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e8cc5ece-6ca8-48e7-93e8-bd3c099e5970 None None] [instance: cd2f9cf3-f43d-40db-ada8-79c50589b1b8] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:53:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-1e7b60a0-9d26-43e4-a36d-976f1b055d14 req-c7501590-61df-4578-9467-b2bd6baee7dd service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-changed-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:53:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-1e7b60a0-9d26-43e4-a36d-976f1b055d14 req-c7501590-61df-4578-9467-b2bd6baee7dd service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Refreshing instance network info cache due to event network-changed-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:53:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e7b60a0-9d26-43e4-a36d-976f1b055d14 req-c7501590-61df-4578-9467-b2bd6baee7dd service nova] Acquiring lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:53:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e7b60a0-9d26-43e4-a36d-976f1b055d14 req-c7501590-61df-4578-9467-b2bd6baee7dd service nova] Acquired lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:53:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-1e7b60a0-9d26-43e4-a36d-976f1b055d14 req-c7501590-61df-4578-9467-b2bd6baee7dd service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Refreshing network info cache for port 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:53:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:53:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:53:20 user nova-compute[73067]: INFO nova.compute.manager [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Detaching volume 20106068-d17b-41d4-84b5-3196972e2787
Aug 16 10:53:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-1e7b60a0-9d26-43e4-a36d-976f1b055d14 req-c7501590-61df-4578-9467-b2bd6baee7dd service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updated VIF entry in instance network info cache for port 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:53:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-1e7b60a0-9d26-43e4-a36d-976f1b055d14 req-c7501590-61df-4578-9467-b2bd6baee7dd service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating instance_info_cache with network_info: [{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:53:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e7b60a0-9d26-43e4-a36d-976f1b055d14 req-c7501590-61df-4578-9467-b2bd6baee7dd service nova] Releasing lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:53:20 user nova-compute[73067]: INFO nova.virt.block_device [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Attempting to driver detach volume 20106068-d17b-41d4-84b5-3196972e2787 from mountpoint /dev/vdb
Aug 16 10:53:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Attempting to detach device vdb from instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:53:21 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:53:21 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:53:21 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:53:21 user nova-compute[73067]:   <serial>20106068-d17b-41d4-84b5-3196972e2787</serial>
Aug 16 10:53:21 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:53:21 user nova-compute[73067]: </disk>
Aug 16 10:53:21 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:53:21 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Successfully detached device vdb from instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b from the persistent domain config.
Aug 16 10:53:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:53:21 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:53:21 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:53:21 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:53:21 user nova-compute[73067]:   <serial>20106068-d17b-41d4-84b5-3196972e2787</serial>
Aug 16 10:53:21 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:53:21 user nova-compute[73067]: </disk>
Aug 16 10:53:21 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692183201.4587417, 58460bde-1b19-4ab9-b23a-5cae27a3b18b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:53:21 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Successfully detached device vdb from instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b from the live domain config.
Aug 16 10:53:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTxjhMAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:53:21 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ded5c1-8970-4096-b402-052ccf5cfa02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a9734c-6460-4382-889b-9e2ea131f439]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:53:21 user nova-compute[73067]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)
Aug 16 10:53:21 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:53:21 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:53:21 user nova-compute[73067]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 (non-flash)
Aug 16 10:53:21 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:53:21 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3544725120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabe3f4c-dc83-482e-b3c5-bf7fd53d9f7b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f62c698-4b6e-4c44-8e6e-26c9bd0a193c]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[969bf388-e520-427a-a807-39f2c3c4dc8a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a64500a-54bb-4abc-bf25-7e5f581d79e9]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f1373-d59c-4372-bacd-a315be0d6baa]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0855af3-e840-425f-9098-916ca8d4ef13]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787, portal: 172.16.0.220,3260]
Aug 16 10:53:21 user nova-compute[73067]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787, portal: 172.16.0.220,3260] successful.
Aug 16 10:53:21 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20106068-d17b-41d4-84b5-3196972e2787 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b546ca-3c9c-41e9-89a2-b95ddfe4e789]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] <== disconnect_volume: return (276ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:53:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:22 user nova-compute[73067]: DEBUG nova.objects.instance [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'flavor' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:53:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8a3f3511-b9fe-4bcb-b39e-22b432a1d735 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.627s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:53:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-f4ee6676-9e34-415d-84b1-dcce13436f69 req-6b4f73f7-f0b4-4a5c-9637-2660d95ca1f6 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-changed-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:53:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-f4ee6676-9e34-415d-84b1-dcce13436f69 req-6b4f73f7-f0b4-4a5c-9637-2660d95ca1f6 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Refreshing instance network info cache due to event network-changed-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:53:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f4ee6676-9e34-415d-84b1-dcce13436f69 req-6b4f73f7-f0b4-4a5c-9637-2660d95ca1f6 service nova] Acquiring lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:53:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f4ee6676-9e34-415d-84b1-dcce13436f69 req-6b4f73f7-f0b4-4a5c-9637-2660d95ca1f6 service nova] Acquired lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:53:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-f4ee6676-9e34-415d-84b1-dcce13436f69 req-6b4f73f7-f0b4-4a5c-9637-2660d95ca1f6 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Refreshing network info cache for port 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:53:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-f4ee6676-9e34-415d-84b1-dcce13436f69 req-6b4f73f7-f0b4-4a5c-9637-2660d95ca1f6 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updated VIF entry in instance network info cache for port 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:53:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-f4ee6676-9e34-415d-84b1-dcce13436f69 req-6b4f73f7-f0b4-4a5c-9637-2660d95ca1f6 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating instance_info_cache with network_info: [{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:53:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f4ee6676-9e34-415d-84b1-dcce13436f69 req-6b4f73f7-f0b4-4a5c-9637-2660d95ca1f6 service nova] Releasing lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:53:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "4bf85594-1255-4383-b359-17ee78c71c6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "4bf85594-1255-4383-b359-17ee78c71c6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:53:35 user nova-compute[73067]: INFO nova.compute.manager [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Terminating instance
Aug 16 10:53:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-338a358a-de22-48c0-9208-bf64d217caf4 req-38169d35-126d-4d1d-ae6a-020148e64b40 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Received event network-vif-unplugged-01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-338a358a-de22-48c0-9208-bf64d217caf4 req-38169d35-126d-4d1d-ae6a-020148e64b40 service nova] Acquiring lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-338a358a-de22-48c0-9208-bf64d217caf4 req-38169d35-126d-4d1d-ae6a-020148e64b40 service nova] Lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-338a358a-de22-48c0-9208-bf64d217caf4 req-38169d35-126d-4d1d-ae6a-020148e64b40 service nova] Lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-338a358a-de22-48c0-9208-bf64d217caf4 req-38169d35-126d-4d1d-ae6a-020148e64b40 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] No waiting events found dispatching network-vif-unplugged-01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-338a358a-de22-48c0-9208-bf64d217caf4 req-38169d35-126d-4d1d-ae6a-020148e64b40 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Received event network-vif-unplugged-01254719-e087-47bd-a902-e887841b2a50 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:53:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:36 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Instance destroyed successfully.
Aug 16 10:53:36 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'resources' on Instance uuid 4bf85594-1255-4383-b359-17ee78c71c6b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-733484165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-733484165',id=31,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:43:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-m7tr93lu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:45:19Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=4bf85594-1255-4383-b359-17ee78c71c6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "01254719-e087-47bd-a902-e887841b2a50", "address": "fa:16:3e:5d:b1:58", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01254719-e0", "ovs_interfaceid": "01254719-e087-47bd-a902-e887841b2a50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=01254719-e087-47bd-a902-e887841b2a50,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01254719-e0') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG os_vif [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=01254719-e087-47bd-a902-e887841b2a50,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01254719-e0') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01254719-e0, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:53:36 user nova-compute[73067]: INFO os_vif [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=01254719-e087-47bd-a902-e887841b2a50,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01254719-e0')
Aug 16 10:53:36 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Deleting instance files /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b_del
Aug 16 10:53:36 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Deletion of /opt/stack/data/nova/instances/4bf85594-1255-4383-b359-17ee78c71c6b_del complete
Aug 16 10:53:36 user nova-compute[73067]: INFO nova.compute.manager [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 10:53:36 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:53:36 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Took 0.43 seconds to deallocate network for instance.
Aug 16 10:53:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:53:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:53:37 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:53:37 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:53:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:53:37 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Deleted allocations for instance 4bf85594-1255-4383-b359-17ee78c71c6b
Aug 16 10:53:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc7c917a-efc6-4b92-a16e-eb41a4abd4a4 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "4bf85594-1255-4383-b359-17ee78c71c6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.777s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:53:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-dfca10d5-87a8-49d5-99f4-59109f6f2f11 req-f4bde1ee-0181-44a0-9c51-ceb9fda1e696 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Received event network-vif-plugged-01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:53:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dfca10d5-87a8-49d5-99f4-59109f6f2f11 req-f4bde1ee-0181-44a0-9c51-ceb9fda1e696 service nova] Acquiring lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:53:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dfca10d5-87a8-49d5-99f4-59109f6f2f11 req-f4bde1ee-0181-44a0-9c51-ceb9fda1e696 service nova] Lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:53:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dfca10d5-87a8-49d5-99f4-59109f6f2f11 req-f4bde1ee-0181-44a0-9c51-ceb9fda1e696 service nova] Lock "4bf85594-1255-4383-b359-17ee78c71c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:53:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-dfca10d5-87a8-49d5-99f4-59109f6f2f11 req-f4bde1ee-0181-44a0-9c51-ceb9fda1e696 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] No waiting events found dispatching network-vif-plugged-01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:53:37 user nova-compute[73067]: WARNING nova.compute.manager [req-dfca10d5-87a8-49d5-99f4-59109f6f2f11 req-f4bde1ee-0181-44a0-9c51-ceb9fda1e696 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Received unexpected event network-vif-plugged-01254719-e087-47bd-a902-e887841b2a50 for instance with vm_state deleted and task_state None.
Aug 16 10:53:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-dfca10d5-87a8-49d5-99f4-59109f6f2f11 req-f4bde1ee-0181-44a0-9c51-ceb9fda1e696 service nova] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Received event network-vif-deleted-01254719-e087-47bd-a902-e887841b2a50 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:53:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:49 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:53:49 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7653MB free_disk=24.92913818359375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 57c883ce-680f-455e-b393-e8c82576d440 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 5270141d-006f-4349-b919-ab3f1b395754 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:53:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183216.29195, 4bf85594-1255-4383-b359-17ee78c71c6b => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:53:51 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] VM Stopped (Lifecycle Event)
Aug 16 10:53:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-666597ea-ad16-41e5-a542-f2d85752e3af None None] [instance: 4bf85594-1255-4383-b359-17ee78c71c6b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:53:51 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating instance_info_cache with network_info: [{"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-58460bde-1b19-4ab9-b23a-5cae27a3b18b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG nova.objects.instance [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'flavor' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:53:52 user nova-compute[73067]: INFO nova.compute.manager [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Attaching volume c4f99769-c127-45b0-83d9-14eb210a7a79 to /dev/vdb
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG os_brick.utils [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67e3970-5118-4e9c-9aea-dcff434d2356]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a90240-ef37-4ef7-a1a4-938cac60b8e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed63ef15-7603-47dd-87f3-401f25ffbbfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6d6a5d-97c9-4535-b89b-e5c3280748e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:53:52 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:53:52 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3972f4d-858d-4163-ad11-70e7bbc7fb6a]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG os_brick.utils [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:53:52 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating existing volume attachment record: 6d0d24c5-2cfd-464e-8283-6c25b4586d31 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:53:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:53:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:02 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:02 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:02 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea4bc5-5f79-460e-a6ce-24e842a7a2d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:54:02 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa2f780-f3fb-41da-a7a3-d20f309126e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79] added
Aug 16 10:54:02 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d3a093-124e-4413-b23c-573bc83e8bef]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8bf2ac-cf72-46a8-9e60-c5d06e87b3a5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVPLGThA {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVPLGThA" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b7285a-28dd-48e7-bc4f-3c433b8379da]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FVPLGThA'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2e257d-888d-44d9-91b9-9013a23b4ecc]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86ff9a5-5ee7-41b4-b099-e743c4663e53]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:02 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:02 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:02 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:02 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55c84a2-5b95-4a22-bf4a-38ca927b9a23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]
Aug 16 10:54:03 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.
Aug 16 10:54:03 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[861d10bc-1c22-4b7a-862b-ba031809efee]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbc5dd4-8ab0-43f9-9cf1-0e7107420396]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:03 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:03 user nova-compute[73067]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:03 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:03 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:03 user nova-compute[73067]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:03 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b6e98-c902-49de-9118-b1979b1e50b8]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:54:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:54:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:04 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26562373131623863', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562373131623863', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:54:04 user nova-compute[73067]: DEBUG nova.objects.instance [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'flavor' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:54:04 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:54:04 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:54:04 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:54:04 user nova-compute[73067]:   <serial>c4f99769-c127-45b0-83d9-14eb210a7a79</serial>
Aug 16 10:54:04 user nova-compute[73067]: </disk>
Aug 16 10:54:04 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:54:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:54:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:54:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] No VIF found with MAC fa:16:3e:43:1e:eb, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:54:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-70c41687-b742-4021-9e4b-f71ccb533eca tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.152s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Stashing vm_state: active {{(pid=73067) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 10:54:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:06 user nova-compute[73067]: DEBUG nova.objects.instance [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'pci_requests' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:06 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:54:06 user nova-compute[73067]: INFO nova.compute.claims [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Claim successful on node user
Aug 16 10:54:06 user nova-compute[73067]: DEBUG nova.objects.instance [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'resources' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:06 user nova-compute[73067]: DEBUG nova.objects.instance [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:06 user nova-compute[73067]: INFO nova.compute.resource_tracker [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating resource usage from migration 859c652e-83f3-407e-b777-fc83695846b4
Aug 16 10:54:07 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:54:07 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:54:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.424s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:07 user nova-compute[73067]: INFO nova.compute.manager [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Migrating
Aug 16 10:54:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:54:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquired lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:54:07 user nova-compute[73067]: DEBUG nova.network.neutron [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:54:07 user nova-compute[73067]: DEBUG nova.network.neutron [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance_info_cache with network_info: [{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:54:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Releasing lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:54:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Starting migrate_disk_and_power_off {{(pid=73067) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-a159d914-53ba-4853-8e0a-b6bacbcdb860 req-886896d0-deff-4ed0-b378-8fddd2ae256d service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-unplugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a159d914-53ba-4853-8e0a-b6bacbcdb860 req-886896d0-deff-4ed0-b378-8fddd2ae256d service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a159d914-53ba-4853-8e0a-b6bacbcdb860 req-886896d0-deff-4ed0-b378-8fddd2ae256d service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a159d914-53ba-4853-8e0a-b6bacbcdb860 req-886896d0-deff-4ed0-b378-8fddd2ae256d service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-a159d914-53ba-4853-8e0a-b6bacbcdb860 req-886896d0-deff-4ed0-b378-8fddd2ae256d service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-unplugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:54:08 user nova-compute[73067]: WARNING nova.compute.manager [req-a159d914-53ba-4853-8e0a-b6bacbcdb860 req-886896d0-deff-4ed0-b378-8fddd2ae256d service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-unplugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state active and task_state resize_migrating.
Aug 16 10:54:08 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance destroyed successfully.
Aug 16 10:54:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-463554452',display_name='tempest-ServerActionsTestOtherB-server-463554452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-463554452',id=37,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy8enApeRn5w4nXD7WPCVzzBNoEPkFBG9nJlwRN/7waOEDMxMNDNxlKwJIIiVsFfVgQ3mgGu5/NIf0JWVMMSGQeHLzR+u6ysEGCe+2qBYt2VQCEd8TlpcOSfKzUrbkTEA==',key_name='tempest-keypair-772909279',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23ae9395e3fe43ff9ca1f7cb0732f821',ramdisk_id='',reservation_id='r-10kef8qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-462247235',owner_user_name='tempest-ServerActionsTestOtherB-462247235-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd560990aeb43b2baba0c299323db7b',uuid=0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-804741563-network", "vif_mac": "fa:16:3e:43:1e:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converting VIF {"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-804741563-network", "vif_mac": "fa:16:3e:43:1e:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_vif [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e8ac84e-9b, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:54:08 user nova-compute[73067]: INFO os_vif [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b')
Aug 16 10:54:08 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:08 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5634680b-9b31-4a4a-bda2-01f89d3e3f9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f37afa7-222f-4765-93aa-82ba345c8cb7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:08 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:08 user nova-compute[73067]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:08 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:08 user nova-compute[73067]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35841ce320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b868bf-f69c-419a-973e-b923c4610fae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03db25f-69d4-49be-a9a7-8f1cf3acfbb0]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7809faf-bc31-4f5c-b38c-5cf10fcd7e36]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f832c0-b494-4e22-9585-c9b44c47f72e]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b3ccb1-ea92-4075-b6ec-6335814f4b6a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebafb673-e5d5-405c-8ba8-113f4874cb3d]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]
Aug 16 10:54:08 user nova-compute[73067]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.
Aug 16 10:54:08 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:08 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65d1d0e-b8cd-4e30-9365-bd02d4bd87ba]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] <== disconnect_volume: return (288ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e_resize/disk /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "cp -r /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e_resize/disk /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk" returned: 0 in 0.211s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e_resize/disk.info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk.info {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "cp -r /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e_resize/disk.info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk.info" returned: 0 in 0.035s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-a6ee047d-a5f6-46bc-bd2e-a965825036d1 req-e7927450-9006-40db-9edc-ebe72ee03d56 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a6ee047d-a5f6-46bc-bd2e-a965825036d1 req-e7927450-9006-40db-9edc-ebe72ee03d56 service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a6ee047d-a5f6-46bc-bd2e-a965825036d1 req-e7927450-9006-40db-9edc-ebe72ee03d56 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a6ee047d-a5f6-46bc-bd2e-a965825036d1 req-e7927450-9006-40db-9edc-ebe72ee03d56 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-a6ee047d-a5f6-46bc-bd2e-a965825036d1 req-e7927450-9006-40db-9edc-ebe72ee03d56 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:54:10 user nova-compute[73067]: WARNING nova.compute.manager [req-a6ee047d-a5f6-46bc-bd2e-a965825036d1 req-e7927450-9006-40db-9edc-ebe72ee03d56 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state active and task_state resize_migrating.
Aug 16 10:54:10 user nova-compute[73067]: DEBUG nova.network.neutron [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Port 8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb binding to destination host user is already ACTIVE {{(pid=73067) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquired lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:54:10 user nova-compute[73067]: DEBUG nova.network.neutron [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:11 user nova-compute[73067]: INFO nova.compute.manager [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Terminating instance
Aug 16 10:54:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-1f8975d7-c35d-4b9d-aa60-7ee3ad63847a req-b1507e65-928f-44e3-b810-b17d6264fd36 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-unplugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1f8975d7-c35d-4b9d-aa60-7ee3ad63847a req-b1507e65-928f-44e3-b810-b17d6264fd36 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1f8975d7-c35d-4b9d-aa60-7ee3ad63847a req-b1507e65-928f-44e3-b810-b17d6264fd36 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1f8975d7-c35d-4b9d-aa60-7ee3ad63847a req-b1507e65-928f-44e3-b810-b17d6264fd36 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-1f8975d7-c35d-4b9d-aa60-7ee3ad63847a req-b1507e65-928f-44e3-b810-b17d6264fd36 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-unplugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-1f8975d7-c35d-4b9d-aa60-7ee3ad63847a req-b1507e65-928f-44e3-b810-b17d6264fd36 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-unplugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:54:11 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Instance destroyed successfully.
Aug 16 10:54:11 user nova-compute[73067]: DEBUG nova.objects.instance [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'resources' on Instance uuid 58460bde-1b19-4ab9-b23a-5cae27a3b18b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1416483222',display_name='tempest-ServerRescueNegativeTestJSON-server-1416483222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1416483222',id=36,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZSCPday0zZtusc90U09XkPuUHqs59FJETrkx7ouQ6+KGHxRpdJeNn8QWjhp0Bkq7FUM8fcLwe989pfZZ9m2BSSvZLbH1uTcIOtXCCyMKKmSIV+hjUiqEXg2HrIkg3OoA==',key_name='tempest-keypair-1950898086',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-0hu2g802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=58460bde-1b19-4ab9-b23a-5cae27a3b18b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "address": "fa:16:3e:5e:10:35", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7f0f43-e4", "ovs_interfaceid": "6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:10:35,bridge_name='br-int',has_traffic_filtering=True,id=6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7f0f43-e4') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG os_vif [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:10:35,bridge_name='br-int',has_traffic_filtering=True,id=6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7f0f43-e4') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a7f0f43-e4, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance_info_cache with network_info: [{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:12 user nova-compute[73067]: INFO os_vif [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:10:35,bridge_name='br-int',has_traffic_filtering=True,id=6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7f0f43-e4')
Aug 16 10:54:12 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Deleting instance files /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b_del
Aug 16 10:54:12 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Deletion of /opt/stack/data/nova/instances/58460bde-1b19-4ab9-b23a-5cae27a3b18b_del complete
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Releasing lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:54:12 user nova-compute[73067]: INFO nova.compute.manager [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG os_brick.utils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bba4a9-ae14-43b1-a4bf-2156eeee6e28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f88ed3-3e16-4c26-9ec8-1084125583dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[138a1290-b6d0-4ca9-b955-9cb9218ae12a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c81434-f6f9-4ba3-8ca9-fe0f4b59efb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:54:12 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:54:12 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4554aea-988d-4084-a551-01b54bd9cd45]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:54:12 user nova-compute[73067]: DEBUG os_brick.utils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-e5ed58af-db96-46f7-8ba9-2b08d1e4303a req-8866b28b-4d6a-4837-8461-7fbab456fa51 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-deleted-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:13 user nova-compute[73067]: INFO nova.compute.manager [req-e5ed58af-db96-46f7-8ba9-2b08d1e4303a req-8866b28b-4d6a-4837-8461-7fbab456fa51 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Neutron deleted interface 6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf; detaching it from the instance and deleting it from the info cache
Aug 16 10:54:13 user nova-compute[73067]: DEBUG nova.network.neutron [req-e5ed58af-db96-46f7-8ba9-2b08d1e4303a req-8866b28b-4d6a-4837-8461-7fbab456fa51 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:54:13 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Took 1.06 seconds to deallocate network for instance.
Aug 16 10:54:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-e5ed58af-db96-46f7-8ba9-2b08d1e4303a req-8866b28b-4d6a-4837-8461-7fbab456fa51 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Detach interface failed, port_id=6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf, reason: Instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:13 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Deleted allocations for instance 58460bde-1b19-4ab9-b23a-5cae27a3b18b
Aug 16 10:54:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-c6de4aa3-3e2c-4d1e-8b7c-eb54f8941aa5 req-ef35da34-9f2d-4f03-8d1a-a319bb808093 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c6de4aa3-3e2c-4d1e-8b7c-eb54f8941aa5 req-ef35da34-9f2d-4f03-8d1a-a319bb808093 service nova] Acquiring lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c6de4aa3-3e2c-4d1e-8b7c-eb54f8941aa5 req-ef35da34-9f2d-4f03-8d1a-a319bb808093 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c6de4aa3-3e2c-4d1e-8b7c-eb54f8941aa5 req-ef35da34-9f2d-4f03-8d1a-a319bb808093 service nova] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-c6de4aa3-3e2c-4d1e-8b7c-eb54f8941aa5 req-ef35da34-9f2d-4f03-8d1a-a319bb808093 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] No waiting events found dispatching network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:54:13 user nova-compute[73067]: WARNING nova.compute.manager [req-c6de4aa3-3e2c-4d1e-8b7c-eb54f8941aa5 req-ef35da34-9f2d-4f03-8d1a-a319bb808093 service nova] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Received unexpected event network-vif-plugged-6a7f0f43-e4f1-4ab3-bc2a-3fff27473acf for instance with vm_state deleted and task_state None.
Aug 16 10:54:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1ee7b97c-f1b5-4a6a-9339-c8cfe1d56f77 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "58460bde-1b19-4ab9-b23a-5cae27a3b18b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.492s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-213e3379-3481-48e8-a236-2c631cbb4b69 req-4acdfa6d-7fe7-4a4b-8e1b-f2539ba7753e service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received event network-changed-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-213e3379-3481-48e8-a236-2c631cbb4b69 req-4acdfa6d-7fe7-4a4b-8e1b-f2539ba7753e service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Refreshing instance network info cache due to event network-changed-95accca5-a977-4d47-964f-57e8451d9cfb. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:54:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-213e3379-3481-48e8-a236-2c631cbb4b69 req-4acdfa6d-7fe7-4a4b-8e1b-f2539ba7753e service nova] Acquiring lock "refresh_cache-f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:54:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-213e3379-3481-48e8-a236-2c631cbb4b69 req-4acdfa6d-7fe7-4a4b-8e1b-f2539ba7753e service nova] Acquired lock "refresh_cache-f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:54:15 user nova-compute[73067]: DEBUG nova.network.neutron [req-213e3379-3481-48e8-a236-2c631cbb4b69 req-4acdfa6d-7fe7-4a4b-8e1b-f2539ba7753e service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Refreshing network info cache for port 95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:54:16 user nova-compute[73067]: DEBUG nova.network.neutron [req-213e3379-3481-48e8-a236-2c631cbb4b69 req-4acdfa6d-7fe7-4a4b-8e1b-f2539ba7753e service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Updated VIF entry in instance network info cache for port 95accca5-a977-4d47-964f-57e8451d9cfb. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:54:16 user nova-compute[73067]: DEBUG nova.network.neutron [req-213e3379-3481-48e8-a236-2c631cbb4b69 req-4acdfa6d-7fe7-4a4b-8e1b-f2539ba7753e service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Updating instance_info_cache with network_info: [{"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:54:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-213e3379-3481-48e8-a236-2c631cbb4b69 req-4acdfa6d-7fe7-4a4b-8e1b-f2539ba7753e service nova] Releasing lock "refresh_cache-f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:54:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:23 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183248.7078807, 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:54:23 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] VM Stopped (Lifecycle Event)
Aug 16 10:54:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7ec6eb54-edde-48c0-b706-1c452c6c7b89 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:54:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7ec6eb54-edde-48c0-b706-1c452c6c7b89 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:54:23 user nova-compute[73067]: INFO nova.compute.manager [None req-7ec6eb54-edde-48c0-b706-1c452c6c7b89 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Starting finish_migration {{(pid=73067) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance directory exists: not creating {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 10:54:25 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Creating image(s)
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.objects.instance [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk. size=21474836480 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk 21474836480 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk 21474836480" returned: 0 in 0.048s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Ensure instance console log exists: /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Start _get_guest_xml network_info=[{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-804741563-network", "vif_mac": "fa:16:3e:43:1e:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e', 'attached_at': '2023-08-16T10:54:25.000000', 'detached_at': '', 'volume_id': 'c4f99769-c127-45b0-83d9-14eb210a7a79', 'serial': 'c4f99769-c127-45b0-83d9-14eb210a7a79'}, 'delete_on_termination': False, 'attachment_id': 'a6adc1f1-1e6e-4b65-b28f-0ca77df74dce', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:54:25 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:54:25 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:54:25 user nova-compute[73067]: DEBUG nova.objects.instance [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:26 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:26 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:26 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3e4b34-219c-41d1-873d-d6d30e7d773d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:54:26 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a97558-8b24-44ca-95e7-f4be3f4099ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79] added
Aug 16 10:54:26 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a87627-2d6e-4886-aae3-8f7654d1d7d9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f202e31-e61e-4281-a748-2de1581f6038]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVPLGThA {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "57c883ce-680f-455e-b393-e8c82576d440" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lazy-loading 'flavor' on Instance uuid f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVPLGThA" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[52920625-8640-4e13-8b17-068b67a4a547]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: INFO nova.compute.manager [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Terminating instance
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FVPLGThA'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc73b14e-b997-44bb-b7d7-b35614bcacae]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[229b7346-3947-4cf0-9ba3-4214d6d25f09]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:26 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:26 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:26 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:26 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3e7cd4-94bb-4f85-9f31-12ec511d73bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]
Aug 16 10:54:26 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.
Aug 16 10:54:26 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6100e1-978b-48da-b185-550bca152a3c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d703e5-1315-4814-9dd0-08f421bb5c5c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:26 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:26 user nova-compute[73067]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:26 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:26 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:26 user nova-compute[73067]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:26 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:26 user nova-compute[73067]: INFO nova.compute.manager [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Attaching volume a43cd2d7-51c1-4b60-aee8-8accc0440327 to /dev/vdb
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4089f043-d584-4381-8a3b-4b2be3bd87f3]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.utils [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75d9a84-8f52-436c-bd3b-bc09a20066c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea30df-fcc1-441a-a130-d1ae7eee1c06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edebcdd-66a6-421b-aa37-523f686c2f68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c549b3a2-b09c-480f-90e3-c4fb69dd27b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.compute.manager [req-685ef0ea-b659-41c3-8e4c-4eb961b13b18 req-3765a6a6-4162-43e6-8122-e87377cf65e0 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-unplugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-685ef0ea-b659-41c3-8e4c-4eb961b13b18 req-3765a6a6-4162-43e6-8122-e87377cf65e0 service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-685ef0ea-b659-41c3-8e4c-4eb961b13b18 req-3765a6a6-4162-43e6-8122-e87377cf65e0 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-685ef0ea-b659-41c3-8e4c-4eb961b13b18 req-3765a6a6-4162-43e6-8122-e87377cf65e0 service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.compute.manager [req-685ef0ea-b659-41c3-8e4c-4eb961b13b18 req-3765a6a6-4162-43e6-8122-e87377cf65e0 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-unplugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.compute.manager [req-685ef0ea-b659-41c3-8e4c-4eb961b13b18 req-3765a6a6-4162-43e6-8122-e87377cf65e0 service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-unplugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:54:26 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:54:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e385312-d467-476a-86d1-1ddd7e2eb0b3]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.utils [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Updating existing volume attachment record: 298e85d8-60a4-4eaf-af96-62f6533b0405 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:26 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Instance destroyed successfully.
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.objects.instance [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'resources' on Instance uuid 57c883ce-680f-455e-b393-e8c82576d440 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1809056316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1809056316',id=24,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:39:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-ogv2vdn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:41:38Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=57c883ce-680f-455e-b393-e8c82576d440,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "address": "fa:16:3e:49:19:c4", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d617b8-2a", "ovs_interfaceid": "75d617b8-2a0f-40a6-9ac3-b22d3ce779f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=75d617b8-2a0f-40a6-9ac3-b22d3ce779f6,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d617b8-2a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_vif [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=75d617b8-2a0f-40a6-9ac3-b22d3ce779f6,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d617b8-2a') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75d617b8-2a, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:54:26 user nova-compute[73067]: INFO os_vif [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=75d617b8-2a0f-40a6-9ac3-b22d3ce779f6,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d617b8-2a')
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAPiGquj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:26 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:26 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183251.9732618, 58460bde-1b19-4ab9-b23a-5cae27a3b18b => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:54:26 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] VM Stopped (Lifecycle Event)
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1dec931d-0e0a-4b97-8cd8-6e29ab348531 None None] [instance: 58460bde-1b19-4ab9-b23a-5cae27a3b18b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26562373131623863', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562373131623863', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.403s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[14835590-92b9-455f-8b5a-29bfd46eff79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-463554452',display_name='tempest-ServerActionsTestOtherB-server-463554452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-463554452',id=37,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy8enApeRn5w4nXD7WPCVzzBNoEPkFBG9nJlwRN/7waOEDMxMNDNxlKwJIIiVsFfVgQ3mgGu5/NIf0JWVMMSGQeHLzR+u6ysEGCe+2qBYt2VQCEd8TlpcOSfKzUrbkTEA==',key_name='tempest-keypair-772909279',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23ae9395e3fe43ff9ca1f7cb0732f821',ramdisk_id='',reservation_id='r-10kef8qy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-462247235',owner_user_name='tempest-ServerActionsTestOtherB-462247235-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd560990aeb43b2baba0c299323db7b',uuid=0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-804741563-network", "vif_mac": "fa:16:3e:43:1e:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converting VIF {"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-804741563-network", "vif_mac": "fa:16:3e:43:1e:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:54:27 user nova-compute[73067]:   <uuid>0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e</uuid>
Aug 16 10:54:27 user nova-compute[73067]:   <name>instance-00000025</name>
Aug 16 10:54:27 user nova-compute[73067]:   <memory>2097152</memory>
Aug 16 10:54:27 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:54:27 user nova-compute[73067]:   <metadata>
Aug 16 10:54:27 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:54:27 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:54:27 user nova-compute[73067]:       <nova:name>tempest-ServerActionsTestOtherB-server-463554452</nova:name>
Aug 16 10:54:27 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:54:25</nova:creationTime>
Aug 16 10:54:27 user nova-compute[73067]:       <nova:flavor name="m1.small">
Aug 16 10:54:27 user nova-compute[73067]:         <nova:memory>2048</nova:memory>
Aug 16 10:54:27 user nova-compute[73067]:         <nova:disk>20</nova:disk>
Aug 16 10:54:27 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:54:27 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:54:27 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:54:27 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:54:27 user nova-compute[73067]:       <nova:owner>
Aug 16 10:54:27 user nova-compute[73067]:         <nova:user uuid="ddd560990aeb43b2baba0c299323db7b">tempest-ServerActionsTestOtherB-462247235-project-member</nova:user>
Aug 16 10:54:27 user nova-compute[73067]:         <nova:project uuid="23ae9395e3fe43ff9ca1f7cb0732f821">tempest-ServerActionsTestOtherB-462247235</nova:project>
Aug 16 10:54:27 user nova-compute[73067]:       </nova:owner>
Aug 16 10:54:27 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:54:27 user nova-compute[73067]:       <nova:ports>
Aug 16 10:54:27 user nova-compute[73067]:         <nova:port uuid="8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb">
Aug 16 10:54:27 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 10:54:27 user nova-compute[73067]:         </nova:port>
Aug 16 10:54:27 user nova-compute[73067]:       </nova:ports>
Aug 16 10:54:27 user nova-compute[73067]:     </nova:instance>
Aug 16 10:54:27 user nova-compute[73067]:   </metadata>
Aug 16 10:54:27 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:54:27 user nova-compute[73067]:     <system>
Aug 16 10:54:27 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:54:27 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:54:27 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:54:27 user nova-compute[73067]:       <entry name="serial">0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e</entry>
Aug 16 10:54:27 user nova-compute[73067]:       <entry name="uuid">0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e</entry>
Aug 16 10:54:27 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:54:27 user nova-compute[73067]:     </system>
Aug 16 10:54:27 user nova-compute[73067]:   </sysinfo>
Aug 16 10:54:27 user nova-compute[73067]:   <os>
Aug 16 10:54:27 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:54:27 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:54:27 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:54:27 user nova-compute[73067]:   </os>
Aug 16 10:54:27 user nova-compute[73067]:   <features>
Aug 16 10:54:27 user nova-compute[73067]:     <acpi/>
Aug 16 10:54:27 user nova-compute[73067]:     <apic/>
Aug 16 10:54:27 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:54:27 user nova-compute[73067]:   </features>
Aug 16 10:54:27 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:54:27 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:54:27 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:54:27 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:54:27 user nova-compute[73067]:   </clock>
Aug 16 10:54:27 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:54:27 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:54:27 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:54:27 user nova-compute[73067]:   </cpu>
Aug 16 10:54:27 user nova-compute[73067]:   <devices>
Aug 16 10:54:27 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:54:27 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:54:27 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk"/>
Aug 16 10:54:27 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:54:27 user nova-compute[73067]:     </disk>
Aug 16 10:54:27 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:54:27 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:54:27 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 10:54:27 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:54:27 user nova-compute[73067]:       <serial>c4f99769-c127-45b0-83d9-14eb210a7a79</serial>
Aug 16 10:54:27 user nova-compute[73067]:     </disk>
Aug 16 10:54:27 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:54:27 user nova-compute[73067]:       <mac address="fa:16:3e:43:1e:eb"/>
Aug 16 10:54:27 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:54:27 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:54:27 user nova-compute[73067]:       <target dev="tap8e8ac84e-9b"/>
Aug 16 10:54:27 user nova-compute[73067]:     </interface>
Aug 16 10:54:27 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:54:27 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/console.log" append="off"/>
Aug 16 10:54:27 user nova-compute[73067]:     </serial>
Aug 16 10:54:27 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:54:27 user nova-compute[73067]:     <video>
Aug 16 10:54:27 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:54:27 user nova-compute[73067]:     </video>
Aug 16 10:54:27 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:54:27 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:54:27 user nova-compute[73067]:     </rng>
Aug 16 10:54:27 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:54:27 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:54:27 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:54:27 user nova-compute[73067]:     </memballoon>
Aug 16 10:54:27 user nova-compute[73067]:   </devices>
Aug 16 10:54:27 user nova-compute[73067]: </domain>
Aug 16 10:54:27 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-463554452',display_name='tempest-ServerActionsTestOtherB-server-463554452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-463554452',id=37,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy8enApeRn5w4nXD7WPCVzzBNoEPkFBG9nJlwRN/7waOEDMxMNDNxlKwJIIiVsFfVgQ3mgGu5/NIf0JWVMMSGQeHLzR+u6ysEGCe+2qBYt2VQCEd8TlpcOSfKzUrbkTEA==',key_name='tempest-keypair-772909279',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23ae9395e3fe43ff9ca1f7cb0732f821',ramdisk_id='',reservation_id='r-10kef8qy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-462247235',owner_user_name='tempest-ServerActionsTestOtherB-462247235-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd560990aeb43b2baba0c299323db7b',uuid=0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-804741563-network", "vif_mac": "fa:16:3e:43:1e:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converting VIF {"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-804741563-network", "vif_mac": "fa:16:3e:43:1e:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_vif [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[72237a15-3999-448f-8978-e4623ace1d3c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e8ac84e-9b, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e8ac84e-9b, col_values=(('external_ids', {'iface-id': '8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:1e:eb', 'vm-uuid': '0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:27 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:27 user nova-compute[73067]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:27 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 (non-flash)
Aug 16 10:54:27 user nova-compute[73067]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:27 user nova-compute[73067]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:27 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642b5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742'): ({'sde'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Removing single pathed devices sde {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:27 user nova-compute[73067]: INFO os_vif [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b')
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[863942f0-897b-4cea-b213-d16c4ec4ca20]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de4c97-852a-4628-9f6d-9d5d692ca303]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Flushing IO for device /dev/sde {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eb10b7-05f5-4f99-96c2-2dd2d2c3803c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] No VIF found with MAC fa:16:3e:43:1e:eb, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0d5410-c99a-47fd-a7fa-04abd08e8655]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] SCSI volumes sde have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[66489e7b-2da7-4700-b1ee-306de601e7b2]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f69fe7-9385-47ae-b6de-cb3af3d6fc7b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742, portal: 172.16.0.220,3260]
Aug 16 10:54:27 user nova-compute[73067]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742, portal: 172.16.0.220,3260] successful.
Aug 16 10:54:27 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b0ebfb-7ee6-46a6-8356-82d777e8a742 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1916a56f-4fc4-4c11-93cf-5d8ecf37137c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] <== disconnect_volume: return (679ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:54:27 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Deleting instance files /opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440_del
Aug 16 10:54:27 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Deletion of /opt/stack/data/nova/instances/57c883ce-680f-455e-b393-e8c82576d440_del complete
Aug 16 10:54:27 user nova-compute[73067]: INFO nova.compute.manager [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Took 1.57 seconds to destroy the instance on the hypervisor.
Aug 16 10:54:27 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:54:27 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 57c883ce-680f-455e-b393-e8c82576d440] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:54:28 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:54:28 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Took 0.51 seconds to deallocate network for instance.
Aug 16 10:54:28 user nova-compute[73067]: DEBUG nova.compute.manager [req-638213f0-5fee-4068-aff8-e9108321d707 req-68ddd9dd-2054-4ba1-8e72-21804c7c9b2f service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-638213f0-5fee-4068-aff8-e9108321d707 req-68ddd9dd-2054-4ba1-8e72-21804c7c9b2f service nova] Acquiring lock "57c883ce-680f-455e-b393-e8c82576d440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-638213f0-5fee-4068-aff8-e9108321d707 req-68ddd9dd-2054-4ba1-8e72-21804c7c9b2f service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-638213f0-5fee-4068-aff8-e9108321d707 req-68ddd9dd-2054-4ba1-8e72-21804c7c9b2f service nova] Lock "57c883ce-680f-455e-b393-e8c82576d440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:28 user nova-compute[73067]: DEBUG nova.compute.manager [req-638213f0-5fee-4068-aff8-e9108321d707 req-68ddd9dd-2054-4ba1-8e72-21804c7c9b2f service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] No waiting events found dispatching network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:54:28 user nova-compute[73067]: WARNING nova.compute.manager [req-638213f0-5fee-4068-aff8-e9108321d707 req-68ddd9dd-2054-4ba1-8e72-21804c7c9b2f service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received unexpected event network-vif-plugged-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 for instance with vm_state active and task_state deleting.
Aug 16 10:54:28 user nova-compute[73067]: DEBUG nova.compute.manager [req-638213f0-5fee-4068-aff8-e9108321d707 req-68ddd9dd-2054-4ba1-8e72-21804c7c9b2f service nova] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Received event network-vif-deleted-75d617b8-2a0f-40a6-9ac3-b22d3ce779f6 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-90c3a958-356f-49fe-a8e7-dc754246784c req-669291e6-09dd-46da-ac4a-faacabacdf76 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-90c3a958-356f-49fe-a8e7-dc754246784c req-669291e6-09dd-46da-ac4a-faacabacdf76 service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-90c3a958-356f-49fe-a8e7-dc754246784c req-669291e6-09dd-46da-ac4a-faacabacdf76 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-90c3a958-356f-49fe-a8e7-dc754246784c req-669291e6-09dd-46da-ac4a-faacabacdf76 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-90c3a958-356f-49fe-a8e7-dc754246784c req-669291e6-09dd-46da-ac4a-faacabacdf76 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:54:29 user nova-compute[73067]: WARNING nova.compute.manager [req-90c3a958-356f-49fe-a8e7-dc754246784c req-669291e6-09dd-46da-ac4a-faacabacdf76 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state active and task_state resize_finish.
Aug 16 10:54:29 user nova-compute[73067]: INFO nova.compute.manager [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Took 0.86 seconds to detach 1 volumes for instance.
Aug 16 10:54:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:54:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:29 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Deleted allocations for instance 57c883ce-680f-455e-b393-e8c82576d440
Aug 16 10:54:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-add64361-0fe0-40b7-aa9d-0b2575f3ca88 tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "57c883ce-680f-455e-b393-e8c82576d440" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.466s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:30 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183270.9829426, 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:54:30 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] VM Resumed (Lifecycle Event)
Aug 16 10:54:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:54:30 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance running successfully.
Aug 16 10:54:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Failed to set time: agent not configured {{(pid=73067) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 10:54:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-723e6f2d-075a-4617-92a5-06de4bdd19b7 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] finish_migration finished successfully. {{(pid=73067) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:54:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 10:54:31 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183270.9840589, 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:54:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] VM Started (Lifecycle Event)
Aug 16 10:54:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-6d0ebd4a-8d11-4f1a-8eb9-610a37a4a738 req-8471f5f3-3739-49da-b47b-0648d2e2e843 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6d0ebd4a-8d11-4f1a-8eb9-610a37a4a738 req-8471f5f3-3739-49da-b47b-0648d2e2e843 service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6d0ebd4a-8d11-4f1a-8eb9-610a37a4a738 req-8471f5f3-3739-49da-b47b-0648d2e2e843 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6d0ebd4a-8d11-4f1a-8eb9-610a37a4a738 req-8471f5f3-3739-49da-b47b-0648d2e2e843 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-6d0ebd4a-8d11-4f1a-8eb9-610a37a4a738 req-8471f5f3-3739-49da-b47b-0648d2e2e843 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:54:31 user nova-compute[73067]: WARNING nova.compute.manager [req-6d0ebd4a-8d11-4f1a-8eb9-610a37a4a738 req-8471f5f3-3739-49da-b47b-0648d2e2e843 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state active and task_state resize_finish.
Aug 16 10:54:31 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 10:54:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-378cf687-ee96-46db-a168-60d28d5c264c req-04e04634-081d-4637-a178-4d68f9f5c965 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-changed-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG nova.compute.manager [req-378cf687-ee96-46db-a168-60d28d5c264c req-04e04634-081d-4637-a178-4d68f9f5c965 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Refreshing instance network info cache due to event network-changed-213380a9-db5d-43fa-9330-72618ec45a34. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-378cf687-ee96-46db-a168-60d28d5c264c req-04e04634-081d-4637-a178-4d68f9f5c965 service nova] Acquiring lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-378cf687-ee96-46db-a168-60d28d5c264c req-04e04634-081d-4637-a178-4d68f9f5c965 service nova] Acquired lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-378cf687-ee96-46db-a168-60d28d5c264c req-04e04634-081d-4637-a178-4d68f9f5c965 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Refreshing network info cache for port 213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:54:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-378cf687-ee96-46db-a168-60d28d5c264c req-04e04634-081d-4637-a178-4d68f9f5c965 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updated VIF entry in instance network info cache for port 213380a9-db5d-43fa-9330-72618ec45a34. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:54:32 user nova-compute[73067]: DEBUG nova.network.neutron [req-378cf687-ee96-46db-a168-60d28d5c264c req-04e04634-081d-4637-a178-4d68f9f5c965 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating instance_info_cache with network_info: [{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:54:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-378cf687-ee96-46db-a168-60d28d5c264c req-04e04634-081d-4637-a178-4d68f9f5c965 service nova] Releasing lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:54:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:35 user nova-compute[73067]: DEBUG nova.objects.instance [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:35 user nova-compute[73067]: INFO nova.compute.manager [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Attaching volume 4f66228f-ad60-4d57-831b-459040cc17ee to /dev/vdb
Aug 16 10:54:35 user nova-compute[73067]: DEBUG os_brick.utils [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adf3e17-aaad-4ab9-a00c-ef193a2111a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[540be25d-88b7-45cc-8108-e41d986f9c0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-45a6ffb2-eedf-4388-8a5b-95729a8d9350 req-79bd6044-7c25-4ddc-8c6d-f853ca7ae068 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-changed-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-45a6ffb2-eedf-4388-8a5b-95729a8d9350 req-79bd6044-7c25-4ddc-8c6d-f853ca7ae068 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Refreshing instance network info cache due to event network-changed-445ee6f3-c506-471f-a69e-b9b21d9fc7d3. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-45a6ffb2-eedf-4388-8a5b-95729a8d9350 req-79bd6044-7c25-4ddc-8c6d-f853ca7ae068 service nova] Acquiring lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-45a6ffb2-eedf-4388-8a5b-95729a8d9350 req-79bd6044-7c25-4ddc-8c6d-f853ca7ae068 service nova] Acquired lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG nova.network.neutron [req-45a6ffb2-eedf-4388-8a5b-95729a8d9350 req-79bd6044-7c25-4ddc-8c6d-f853ca7ae068 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Refreshing network info cache for port 445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed633a0e-b4b3-4316-87d8-8b0ec7fb82ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4d4309-e575-414d-bd32-c843cf092961]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:54:36 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:54:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[850888dd-f8a3-4193-8e81-5672e61b0efb]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG os_brick.utils [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating existing volume attachment record: 42cb3870-d93a-4df7-9d06-5153a03d0d1f {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:54:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDmMCtid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:37 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:37 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:37 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0367fb4b-d0a5-4e49-b782-ee999aab393d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:54:37 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cf1c1a-4f50-4907-9270-1fb1ff5538ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327] added
Aug 16 10:54:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bec096a-5d8a-4452-81f1-bd7089c4aa3d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[875dc30d-7339-40a7-afa2-c7ce73b30c54]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDmMCtid {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG nova.network.neutron [req-45a6ffb2-eedf-4388-8a5b-95729a8d9350 req-79bd6044-7c25-4ddc-8c6d-f853ca7ae068 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updated VIF entry in instance network info cache for port 445ee6f3-c506-471f-a69e-b9b21d9fc7d3. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG nova.network.neutron [req-45a6ffb2-eedf-4388-8a5b-95729a8d9350 req-79bd6044-7c25-4ddc-8c6d-f853ca7ae068 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updating instance_info_cache with network_info: [{"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDmMCtid" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11410f0-e1f4-47c5-a7d0-088e75d129d5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDmMCtid'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-45a6ffb2-eedf-4388-8a5b-95729a8d9350 req-79bd6044-7c25-4ddc-8c6d-f853ca7ae068 service nova] Releasing lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[68892df2-117c-44e2-b68f-2a9f15e5abdb]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e09f6e-6b48-4c7b-b594-570a2f8afbce]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:37 user nova-compute[73067]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:37 user nova-compute[73067]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffc6e29-184b-48d5-9399-93ab10e9f9fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327, portal: 172.16.0.220,3260]
Aug 16 10:54:37 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327, portal: 172.16.0.220,3260] successful.
Aug 16 10:54:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdceb876-8731-4748-a857-ae3484b0c3fa]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0449a41-7f5a-450f-ac60-8fca2657d4d7]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:37 user nova-compute[73067]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:37 user nova-compute[73067]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 (non-flash)
Aug 16 10:54:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:37 user nova-compute[73067]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:37 user nova-compute[73067]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 (non-flash)
Aug 16 10:54:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[936541ac-18c0-4dc4-820b-28391aaaf482]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDmMCtid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:37 user nova-compute[73067]: INFO nova.compute.manager [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Detaching volume bac75f5e-d759-4e95-b73e-e90ceb6a903c
Aug 16 10:54:38 user nova-compute[73067]: INFO nova.virt.block_device [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Attempting to driver detach volume bac75f5e-d759-4e95-b73e-e90ceb6a903c from mountpoint /dev/vdb
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Attempting to detach device vdb from instance 5270141d-006f-4349-b919-ab3f1b395754 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:54:38 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:54:38 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:54:38 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:54:38 user nova-compute[73067]:   <serial>bac75f5e-d759-4e95-b73e-e90ceb6a903c</serial>
Aug 16 10:54:38 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:54:38 user nova-compute[73067]: </disk>
Aug 16 10:54:38 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:54:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Successfully detached device vdb from instance 5270141d-006f-4349-b919-ab3f1b395754 from the persistent domain config.
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5270141d-006f-4349-b919-ab3f1b395754 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:54:38 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:54:38 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:54:38 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:54:38 user nova-compute[73067]:   <serial>bac75f5e-d759-4e95-b73e-e90ceb6a903c</serial>
Aug 16 10:54:38 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:54:38 user nova-compute[73067]: </disk>
Aug 16 10:54:38 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-bae81b56-1d47-4e49-bc44-dfba0f156ab7 req-af4ca837-654b-48a9-98c9-296772f37132 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-changed-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.compute.manager [req-bae81b56-1d47-4e49-bc44-dfba0f156ab7 req-af4ca837-654b-48a9-98c9-296772f37132 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Refreshing instance network info cache due to event network-changed-445ee6f3-c506-471f-a69e-b9b21d9fc7d3. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bae81b56-1d47-4e49-bc44-dfba0f156ab7 req-af4ca837-654b-48a9-98c9-296772f37132 service nova] Acquiring lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bae81b56-1d47-4e49-bc44-dfba0f156ab7 req-af4ca837-654b-48a9-98c9-296772f37132 service nova] Acquired lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.network.neutron [req-bae81b56-1d47-4e49-bc44-dfba0f156ab7 req-af4ca837-654b-48a9-98c9-296772f37132 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Refreshing network info cache for port 445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692183278.4914792, 5270141d-006f-4349-b919-ab3f1b395754 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5270141d-006f-4349-b919-ab3f1b395754 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:54:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Successfully detached device vdb from instance 5270141d-006f-4349-b919-ab3f1b395754 from the live domain config.
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puWOSCxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:38 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.network.neutron [req-bae81b56-1d47-4e49-bc44-dfba0f156ab7 req-af4ca837-654b-48a9-98c9-296772f37132 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updated VIF entry in instance network info cache for port 445ee6f3-c506-471f-a69e-b9b21d9fc7d3. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.network.neutron [req-bae81b56-1d47-4e49-bc44-dfba0f156ab7 req-af4ca837-654b-48a9-98c9-296772f37132 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updating instance_info_cache with network_info: [{"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bae81b56-1d47-4e49-bc44-dfba0f156ab7 req-af4ca837-654b-48a9-98c9-296772f37132 service nova] Releasing lock "refresh_cache-5270141d-006f-4349-b919-ab3f1b395754" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23335613637663839', 'path': '/dev/sdd'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335613637663839', 'path': '/dev/sdd'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.213s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lazy-loading 'flavor' on Instance uuid f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba2f34-6b75-4cbf-a734-8ad672d12c90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:54:38 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:54:38 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 10:54:38 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:54:38 user nova-compute[73067]:   <serial>a43cd2d7-51c1-4b60-aee8-8accc0440327</serial>
Aug 16 10:54:38 user nova-compute[73067]: </disk>
Aug 16 10:54:38 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[14afc21d-d315-4977-a0eb-8881bf5fb366]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:38 user nova-compute[73067]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:38 user nova-compute[73067]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 (non-flash)
Aug 16 10:54:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c (non-flash)
Aug 16 10:54:38 user nova-compute[73067]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:38 user nova-compute[73067]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 (non-flash)
Aug 16 10:54:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f356462fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be9562a-0033-4fa9-8afa-f4843bd952cb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0219f195-11e2-4693-aef0-6d9eca92dc48]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e693317c-36b6-4c31-b2fe-a7994f973f7c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8896d0-3371-484e-b6e1-7e95e469c2c7]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[00170a9d-1a1f-4ec7-b266-702c9ccdd450]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf00ce-c3ae-4213-8764-5a366053bcd1]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c, portal: 172.16.0.220,3260]
Aug 16 10:54:38 user nova-compute[73067]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c, portal: 172.16.0.220,3260] successful.
Aug 16 10:54:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac75f5e-d759-4e95-b73e-e90ceb6a903c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2370aa2-acf6-46b1-b643-ef46ecc31f21]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] <== disconnect_volume: return (488ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:54:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:54:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:54:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] No VIF found with MAC fa:16:3e:79:c1:d5, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:54:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e4380b28-89b4-4bf1-a2f3-2a9672dda514 tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.109s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'flavor' on Instance uuid 5270141d-006f-4349-b919-ab3f1b395754 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-952b9d66-d971-4f55-abd7-79543167ed80 tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.894s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:41 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183266.9167197, 57c883ce-680f-455e-b393-e8c82576d440 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:54:41 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 57c883ce-680f-455e-b393-e8c82576d440] VM Stopped (Lifecycle Event)
Aug 16 10:54:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-40d2152f-a8f4-4992-8d6a-f5fe514c579b None None] [instance: 57c883ce-680f-455e-b393-e8c82576d440] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:42 user nova-compute[73067]: INFO nova.compute.manager [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Detaching volume a43cd2d7-51c1-4b60-aee8-8accc0440327
Aug 16 10:54:42 user nova-compute[73067]: INFO nova.virt.block_device [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Attempting to driver detach volume a43cd2d7-51c1-4b60-aee8-8accc0440327 from mountpoint /dev/vdb
Aug 16 10:54:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Attempting to detach device vdb from instance f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:54:42 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:54:42 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 10:54:42 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:54:42 user nova-compute[73067]:   <serial>a43cd2d7-51c1-4b60-aee8-8accc0440327</serial>
Aug 16 10:54:42 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:54:42 user nova-compute[73067]: </disk>
Aug 16 10:54:42 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:54:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Successfully detached device vdb from instance f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 from the persistent domain config.
Aug 16 10:54:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:54:42 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:54:42 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 10:54:42 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:54:42 user nova-compute[73067]:   <serial>a43cd2d7-51c1-4b60-aee8-8accc0440327</serial>
Aug 16 10:54:42 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 10:54:42 user nova-compute[73067]: </disk>
Aug 16 10:54:42 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692183282.859203, f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:54:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Successfully detached device vdb from instance f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 from the live domain config.
Aug 16 10:54:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDmMCtid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:42 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc51fd23-cd91-4cf7-81a7-bfe65b011e5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ad23f1-1dc3-4245-8bf7-f299c632f5df]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:42 user nova-compute[73067]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 (non-flash)
Aug 16 10:54:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:42 user nova-compute[73067]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 (non-flash)
Aug 16 10:54:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3544725f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327'): ({'sdd'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Removing single pathed devices sdd {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bf34a7-660e-4556-afaf-0fae636f7c74]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfcd96e-fc97-499e-9703-b258a91bd3ef]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Flushing IO for device /dev/sdd {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:54:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b8b653-decc-48e6-8934-fa39c9ee7452]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[532b8ac8-6f54-4666-a1f9-6f2d9dcb4330]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c633e1-e968-495c-b0d7-c61606a8da20]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc54990-04bf-4207-aa34-f0e3fc183657]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327, portal: 172.16.0.220,3260]
Aug 16 10:54:43 user nova-compute[73067]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327, portal: 172.16.0.220,3260] successful.
Aug 16 10:54:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43cd2d7-51c1-4b60-aee8-8accc0440327 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7d9975-7ac2-44ca-bbf5-9a906106d9a3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] <== disconnect_volume: return (281ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lazy-loading 'flavor' on Instance uuid f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-fa635d4c-eb9f-432b-afcc-bfb222f733ff tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.722s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaOPNTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:54:46 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:46 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:54:46 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b4c00c-2ce0-4758-bb3e-1afda43fe8e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:54:46 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[48627150-d5e7-48b7-925a-634e7ad3d55f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee] added
Aug 16 10:54:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca6639d-3d92-4174-8871-968d2ebd3ea9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b1578d-5787-4079-9d46-464db6755fd0]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaOPNTpB {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaOPNTpB" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f2f5b6-984c-4772-9a07-a8079d042e1e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XaOPNTpB'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49b9924-3e84-4977-b89e-aa435a58e47f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc0ff1d-10a9-4b87-a273-5efd63618b62]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1152fc0-96ee-4433-ae03-ac454e8e6a9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260]
Aug 16 10:54:46 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260] successful.
Aug 16 10:54:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8661f6c8-1452-487f-bea6-fbd4ced00118]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d096cb5-afa6-4666-8050-13960a8c9a57]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:46 user nova-compute[73067]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:54:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:54:46 user nova-compute[73067]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:54:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:54:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[10440b67-2dd3-4e43-985c-8c811515e895]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:47 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaOPNTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26539363465323937', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539363465323937', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:54:48 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:54:48 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:54:48 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:54:48 user nova-compute[73067]:   <serial>4f66228f-ad60-4d57-831b-459040cc17ee</serial>
Aug 16 10:54:48 user nova-compute[73067]: </disk>
Aug 16 10:54:48 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No VIF found with MAC fa:16:3e:f5:ee:ed, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c1de41c4-f087-4043-9931-8f9a7e01c614 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.769s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a6e3247e-4741-4480-90e1-d6c38ec1489b tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a6e3247e-4741-4480-90e1-d6c38ec1489b tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a6e3247e-4741-4480-90e1-d6c38ec1489b tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a6e3247e-4741-4480-90e1-d6c38ec1489b tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73067) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-a6e3247e-4741-4480-90e1-d6c38ec1489b tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:48 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-88dd6d94-fba6-40a6-9ec4-b4ad1be49d51 req-45379a78-22bb-4628-bffb-7c2fae69b4ed service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-unplugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-88dd6d94-fba6-40a6-9ec4-b4ad1be49d51 req-45379a78-22bb-4628-bffb-7c2fae69b4ed service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-88dd6d94-fba6-40a6-9ec4-b4ad1be49d51 req-45379a78-22bb-4628-bffb-7c2fae69b4ed service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-88dd6d94-fba6-40a6-9ec4-b4ad1be49d51 req-45379a78-22bb-4628-bffb-7c2fae69b4ed service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-88dd6d94-fba6-40a6-9ec4-b4ad1be49d51 req-45379a78-22bb-4628-bffb-7c2fae69b4ed service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-unplugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:54:49 user nova-compute[73067]: WARNING nova.compute.manager [req-88dd6d94-fba6-40a6-9ec4-b4ad1be49d51 req-45379a78-22bb-4628-bffb-7c2fae69b4ed service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-unplugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state active and task_state powering-off.
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance destroyed successfully.
Aug 16 10:54:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a6e3247e-4741-4480-90e1-d6c38ec1489b tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a6e3247e-4741-4480-90e1-d6c38ec1489b tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.887s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:54:50 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:54:50 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=7875MB free_disk=24.925537109375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Applying migration context for instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e as it has an incoming, in-progress migration 859c652e-83f3-407e-b777-fc83695846b4. Migration status is finished {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 10:54:50 user nova-compute[73067]: INFO nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating resource usage from migration 859c652e-83f3-407e-b777-fc83695846b4
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 5270141d-006f-4349-b919-ab3f1b395754 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Migration 859c652e-83f3-407e-b777-fc83695846b4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:54:50 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:54:51 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:54:51 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:54:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-5e8057ff-a71e-4b34-b985-d2516239c396 req-900b471a-fe90-4a87-88cb-0d39141670a3 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:54:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5e8057ff-a71e-4b34-b985-d2516239c396 req-900b471a-fe90-4a87-88cb-0d39141670a3 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:54:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5e8057ff-a71e-4b34-b985-d2516239c396 req-900b471a-fe90-4a87-88cb-0d39141670a3 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:54:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5e8057ff-a71e-4b34-b985-d2516239c396 req-900b471a-fe90-4a87-88cb-0d39141670a3 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:54:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-5e8057ff-a71e-4b34-b985-d2516239c396 req-900b471a-fe90-4a87-88cb-0d39141670a3 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:54:51 user nova-compute[73067]: WARNING nova.compute.manager [req-5e8057ff-a71e-4b34-b985-d2516239c396 req-900b471a-fe90-4a87-88cb-0d39141670a3 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state stopped and task_state None.
Aug 16 10:54:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updating instance_info_cache with network_info: [{"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:54:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:54:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:54:53 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:54:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:54:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:54:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:04 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183289.6891484, e3815a53-0792-4d95-bb08-bb40cf42f1d4 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:55:04 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] VM Stopped (Lifecycle Event)
Aug 16 10:55:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-bfa9f271-c59c-4e55-b031-fc6ada1b6a18 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:55:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-bfa9f271-c59c-4e55-b031-fc6ada1b6a18 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:55:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:55:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:55:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:55:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:16 user nova-compute[73067]: INFO nova.compute.manager [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Terminating instance
Aug 16 10:55:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-ee80c6e7-4af8-4f17-88e8-1c0c40a9d824 req-ae026cb5-c8f0-4466-9aca-d96cee9cb455 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-vif-unplugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ee80c6e7-4af8-4f17-88e8-1c0c40a9d824 req-ae026cb5-c8f0-4466-9aca-d96cee9cb455 service nova] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ee80c6e7-4af8-4f17-88e8-1c0c40a9d824 req-ae026cb5-c8f0-4466-9aca-d96cee9cb455 service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ee80c6e7-4af8-4f17-88e8-1c0c40a9d824 req-ae026cb5-c8f0-4466-9aca-d96cee9cb455 service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-ee80c6e7-4af8-4f17-88e8-1c0c40a9d824 req-ae026cb5-c8f0-4466-9aca-d96cee9cb455 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] No waiting events found dispatching network-vif-unplugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-ee80c6e7-4af8-4f17-88e8-1c0c40a9d824 req-ae026cb5-c8f0-4466-9aca-d96cee9cb455 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-vif-unplugged-b466c179-fedb-44c5-84db-52a28279e32c for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Instance destroyed successfully.
Aug 16 10:55:16 user nova-compute[73067]: DEBUG nova.objects.instance [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'resources' on Instance uuid f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1969020103',display_name='tempest-ServerRescueNegativeTestJSON-server-1969020103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1969020103',id=28,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-4faijbkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:40:46Z,user_data=None,user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "b466c179-fedb-44c5-84db-52a28279e32c", "address": "fa:16:3e:91:ac:12", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb466c179-fe", "ovs_interfaceid": "b466c179-fedb-44c5-84db-52a28279e32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=b466c179-fedb-44c5-84db-52a28279e32c,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb466c179-fe') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG os_vif [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=b466c179-fedb-44c5-84db-52a28279e32c,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb466c179-fe') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb466c179-fe, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:16 user nova-compute[73067]: INFO os_vif [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=b466c179-fedb-44c5-84db-52a28279e32c,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb466c179-fe')
Aug 16 10:55:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Deleting instance files /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7_del
Aug 16 10:55:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Deletion of /opt/stack/data/nova/instances/f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7_del complete
Aug 16 10:55:17 user nova-compute[73067]: INFO nova.compute.manager [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:17 user nova-compute[73067]: INFO nova.compute.manager [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Terminating instance
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.compute.manager [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-e7a4e77a-69b9-45b3-87ce-09f5fc68bc35 req-ac5e3eda-ddb5-41a6-a644-22e0b70da93d service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Received event network-vif-unplugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e7a4e77a-69b9-45b3-87ce-09f5fc68bc35 req-ac5e3eda-ddb5-41a6-a644-22e0b70da93d service nova] Acquiring lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e7a4e77a-69b9-45b3-87ce-09f5fc68bc35 req-ac5e3eda-ddb5-41a6-a644-22e0b70da93d service nova] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e7a4e77a-69b9-45b3-87ce-09f5fc68bc35 req-ac5e3eda-ddb5-41a6-a644-22e0b70da93d service nova] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-e7a4e77a-69b9-45b3-87ce-09f5fc68bc35 req-ac5e3eda-ddb5-41a6-a644-22e0b70da93d service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] No waiting events found dispatching network-vif-unplugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-e7a4e77a-69b9-45b3-87ce-09f5fc68bc35 req-ac5e3eda-ddb5-41a6-a644-22e0b70da93d service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Received event network-vif-unplugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:55:17 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Took 0.66 seconds to deallocate network for instance.
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.compute.manager [req-a94d8684-ec90-41b2-80f3-70466ef68548 req-29f449d5-789c-4133-8049-8275fd9912e9 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-vif-deleted-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:17 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Instance destroyed successfully.
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.objects.instance [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lazy-loading 'resources' on Instance uuid a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1411715053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1411715053',id=19,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:34:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d03e64450654fd693d6a1bd43017880',ramdisk_id='',reservation_id='r-p8ddrnk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:36:45Z,user_data=None,user_id='d3b135edcf064595b8d93052903696a7',uuid=a9bb7311-5960-4a6f-8635-bd3fd7bc30d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converting VIF {"id": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "address": "fa:16:3e:85:34:2a", "network": {"id": "c218ba7f-579e-4203-ae0c-36804b7f2a10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-314138683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d03e64450654fd693d6a1bd43017880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf5dd87-9e", "ovs_interfaceid": "2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf5dd87-9e') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG os_vif [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf5dd87-9e') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bf5dd87-9e, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:17 user nova-compute[73067]: INFO os_vif [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40,network=Network(c218ba7f-579e-4203-ae0c-36804b7f2a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf5dd87-9e')
Aug 16 10:55:17 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Deleting instance files /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1_del
Aug 16 10:55:17 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Deletion of /opt/stack/data/nova/instances/a9bb7311-5960-4a6f-8635-bd3fd7bc30d1_del complete
Aug 16 10:55:17 user nova-compute[73067]: INFO nova.compute.manager [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:55:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:18 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Deleted allocations for instance f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7
Aug 16 10:55:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-bb3c0c52-1d90-4af4-80db-784c8a7500b8 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.093s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-4e571dab-f4a4-4a5c-b168-27896cbcbf5c req-2b647d67-717b-42e3-8636-be2c364f2cf2 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4e571dab-f4a4-4a5c-b168-27896cbcbf5c req-2b647d67-717b-42e3-8636-be2c364f2cf2 service nova] Acquiring lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4e571dab-f4a4-4a5c-b168-27896cbcbf5c req-2b647d67-717b-42e3-8636-be2c364f2cf2 service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4e571dab-f4a4-4a5c-b168-27896cbcbf5c req-2b647d67-717b-42e3-8636-be2c364f2cf2 service nova] Lock "f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-4e571dab-f4a4-4a5c-b168-27896cbcbf5c req-2b647d67-717b-42e3-8636-be2c364f2cf2 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] No waiting events found dispatching network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:55:18 user nova-compute[73067]: WARNING nova.compute.manager [req-4e571dab-f4a4-4a5c-b168-27896cbcbf5c req-2b647d67-717b-42e3-8636-be2c364f2cf2 service nova] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Received unexpected event network-vif-plugged-b466c179-fedb-44c5-84db-52a28279e32c for instance with vm_state deleted and task_state None.
Aug 16 10:55:18 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:55:18 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Took 0.57 seconds to deallocate network for instance.
Aug 16 10:55:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:18 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:55:18 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:55:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:18 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Deleted allocations for instance a9bb7311-5960-4a6f-8635-bd3fd7bc30d1
Aug 16 10:55:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a8c3b5e5-00bf-45ef-88f1-75e02c1ea84c tempest-ServerBootFromVolumeStableRescueTest-1973630968 tempest-ServerBootFromVolumeStableRescueTest-1973630968-project-member] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.824s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-1e5d3179-35f5-46aa-b12d-cb6a29e43130 req-50266b2b-719b-4904-bccd-b90b4debe9ac service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Received event network-vif-plugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e5d3179-35f5-46aa-b12d-cb6a29e43130 req-50266b2b-719b-4904-bccd-b90b4debe9ac service nova] Acquiring lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e5d3179-35f5-46aa-b12d-cb6a29e43130 req-50266b2b-719b-4904-bccd-b90b4debe9ac service nova] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1e5d3179-35f5-46aa-b12d-cb6a29e43130 req-50266b2b-719b-4904-bccd-b90b4debe9ac service nova] Lock "a9bb7311-5960-4a6f-8635-bd3fd7bc30d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-1e5d3179-35f5-46aa-b12d-cb6a29e43130 req-50266b2b-719b-4904-bccd-b90b4debe9ac service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] No waiting events found dispatching network-vif-plugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:55:19 user nova-compute[73067]: WARNING nova.compute.manager [req-1e5d3179-35f5-46aa-b12d-cb6a29e43130 req-50266b2b-719b-4904-bccd-b90b4debe9ac service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Received unexpected event network-vif-plugged-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 for instance with vm_state deleted and task_state None.
Aug 16 10:55:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-32e22034-1468-4754-aba4-0562dd3586a6 req-95160015-09e7-4faa-9e0b-60f48e915637 service nova] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Received event network-vif-deleted-2bf5dd87-9ead-4c82-b4ee-1cd8d5953c40 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:31 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183316.8224425, f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:55:31 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] VM Stopped (Lifecycle Event)
Aug 16 10:55:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1f5ed76e-85ee-4f0e-93ac-99aa9f88cb61 None None] [instance: f71fd3b8-9a56-45bb-8e41-afbf71bb8cd7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:55:32 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183317.7893233, a9bb7311-5960-4a6f-8635-bd3fd7bc30d1 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:55:32 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] VM Stopped (Lifecycle Event)
Aug 16 10:55:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d94982cb-469d-4d57-b21a-6f7aaf3a618f None None] [instance: a9bb7311-5960-4a6f-8635-bd3fd7bc30d1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:55:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:34 user nova-compute[73067]: INFO nova.compute.manager [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Terminating instance
Aug 16 10:55:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:55:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-913aebab-a33c-4352-9c96-ce435d8327c5 req-d071321c-7c62-48f6-87da-7183931e89a7 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-vif-unplugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-913aebab-a33c-4352-9c96-ce435d8327c5 req-d071321c-7c62-48f6-87da-7183931e89a7 service nova] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-913aebab-a33c-4352-9c96-ce435d8327c5 req-d071321c-7c62-48f6-87da-7183931e89a7 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-913aebab-a33c-4352-9c96-ce435d8327c5 req-d071321c-7c62-48f6-87da-7183931e89a7 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-913aebab-a33c-4352-9c96-ce435d8327c5 req-d071321c-7c62-48f6-87da-7183931e89a7 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] No waiting events found dispatching network-vif-unplugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-913aebab-a33c-4352-9c96-ce435d8327c5 req-d071321c-7c62-48f6-87da-7183931e89a7 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-vif-unplugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:55:35 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Instance destroyed successfully.
Aug 16 10:55:35 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lazy-loading 'resources' on Instance uuid 5270141d-006f-4349-b919-ab3f1b395754 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1300160645',display_name='tempest-TestMinimumBasicScenario-server-1300160645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1300160645',id=38,image_ref='c2809392-21b8-4e9b-83d4-eac618a30960',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUXziBSGbvXdUn7iN6XtIurJBMKr+SypYAqVnz40uikeXUZV4yz7E+ezeQBdSGvHbkLIFcvKx4e1n+1zM4texgt4iiarq4wfq8RR0qkUBMDHjQRS0ngTdTUeAAvoW9T1A==',key_name='tempest-TestMinimumBasicScenario-17108840',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:50:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd5f36d1e3e24603bf6832c3b46a2942',ramdisk_id='',reservation_id='r-zs1f06xq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c2809392-21b8-4e9b-83d4-eac618a30960',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1702842771',owner_user_name='tempest-TestMinimumBasicScenario-1702842771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:52:53Z,user_data=None,user_id='61f8d65b293a41acb5aca991e2e41d57',uuid=5270141d-006f-4349-b919-ab3f1b395754,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converting VIF {"id": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "address": "fa:16:3e:0f:a6:f7", "network": {"id": "dc6895f1-6447-43a1-bdc0-241f0cb5ada2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1176463971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd5f36d1e3e24603bf6832c3b46a2942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445ee6f3-c5", "ovs_interfaceid": "445ee6f3-c506-471f-a69e-b9b21d9fc7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a6:f7,bridge_name='br-int',has_traffic_filtering=True,id=445ee6f3-c506-471f-a69e-b9b21d9fc7d3,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445ee6f3-c5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG os_vif [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a6:f7,bridge_name='br-int',has_traffic_filtering=True,id=445ee6f3-c506-471f-a69e-b9b21d9fc7d3,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445ee6f3-c5') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap445ee6f3-c5, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:35 user nova-compute[73067]: INFO os_vif [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a6:f7,bridge_name='br-int',has_traffic_filtering=True,id=445ee6f3-c506-471f-a69e-b9b21d9fc7d3,network=Network(dc6895f1-6447-43a1-bdc0-241f0cb5ada2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445ee6f3-c5')
Aug 16 10:55:35 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Deleting instance files /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754_del
Aug 16 10:55:35 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Deletion of /opt/stack/data/nova/instances/5270141d-006f-4349-b919-ab3f1b395754_del complete
Aug 16 10:55:35 user nova-compute[73067]: INFO nova.compute.manager [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 10:55:35 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:55:35 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 5270141d-006f-4349-b919-ab3f1b395754] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:55:36 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:55:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-3c7bb8e9-d6ff-4761-9b8f-316feabc45ea req-2c19db8e-7e08-4422-902b-7c93a5e85ef5 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-vif-deleted-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:36 user nova-compute[73067]: INFO nova.compute.manager [req-3c7bb8e9-d6ff-4761-9b8f-316feabc45ea req-2c19db8e-7e08-4422-902b-7c93a5e85ef5 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Neutron deleted interface 445ee6f3-c506-471f-a69e-b9b21d9fc7d3; detaching it from the instance and deleting it from the info cache
Aug 16 10:55:36 user nova-compute[73067]: DEBUG nova.network.neutron [req-3c7bb8e9-d6ff-4761-9b8f-316feabc45ea req-2c19db8e-7e08-4422-902b-7c93a5e85ef5 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:55:36 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Took 0.58 seconds to deallocate network for instance.
Aug 16 10:55:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-3c7bb8e9-d6ff-4761-9b8f-316feabc45ea req-2c19db8e-7e08-4422-902b-7c93a5e85ef5 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Detach interface failed, port_id=445ee6f3-c506-471f-a69e-b9b21d9fc7d3, reason: Instance 5270141d-006f-4349-b919-ab3f1b395754 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:55:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:36 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:55:36 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:55:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:36 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Deleted allocations for instance 5270141d-006f-4349-b919-ab3f1b395754
Aug 16 10:55:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ed56a969-6e2f-4ace-98b4-ca1e8111d72a tempest-TestMinimumBasicScenario-1702842771 tempest-TestMinimumBasicScenario-1702842771-project-member] Lock "5270141d-006f-4349-b919-ab3f1b395754" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.882s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-a22984ab-bc55-4e6a-b488-0645c6ddd94b req-b953c879-fbad-4707-985d-a3d013bbc864 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a22984ab-bc55-4e6a-b488-0645c6ddd94b req-b953c879-fbad-4707-985d-a3d013bbc864 service nova] Acquiring lock "5270141d-006f-4349-b919-ab3f1b395754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a22984ab-bc55-4e6a-b488-0645c6ddd94b req-b953c879-fbad-4707-985d-a3d013bbc864 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a22984ab-bc55-4e6a-b488-0645c6ddd94b req-b953c879-fbad-4707-985d-a3d013bbc864 service nova] Lock "5270141d-006f-4349-b919-ab3f1b395754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:37 user nova-compute[73067]: DEBUG nova.compute.manager [req-a22984ab-bc55-4e6a-b488-0645c6ddd94b req-b953c879-fbad-4707-985d-a3d013bbc864 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] No waiting events found dispatching network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:55:37 user nova-compute[73067]: WARNING nova.compute.manager [req-a22984ab-bc55-4e6a-b488-0645c6ddd94b req-b953c879-fbad-4707-985d-a3d013bbc864 service nova] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Received unexpected event network-vif-plugged-445ee6f3-c506-471f-a69e-b9b21d9fc7d3 for instance with vm_state deleted and task_state None.
Aug 16 10:55:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:39 user nova-compute[73067]: INFO nova.compute.manager [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Terminating instance
Aug 16 10:55:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-37d8c00d-aeef-4116-a1d3-2b0474cbe5ba req-ecfb35cb-80ec-4c6c-b60e-ef15f984f683 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received event network-vif-unplugged-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-37d8c00d-aeef-4116-a1d3-2b0474cbe5ba req-ecfb35cb-80ec-4c6c-b60e-ef15f984f683 service nova] Acquiring lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-37d8c00d-aeef-4116-a1d3-2b0474cbe5ba req-ecfb35cb-80ec-4c6c-b60e-ef15f984f683 service nova] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-37d8c00d-aeef-4116-a1d3-2b0474cbe5ba req-ecfb35cb-80ec-4c6c-b60e-ef15f984f683 service nova] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-37d8c00d-aeef-4116-a1d3-2b0474cbe5ba req-ecfb35cb-80ec-4c6c-b60e-ef15f984f683 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] No waiting events found dispatching network-vif-unplugged-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-37d8c00d-aeef-4116-a1d3-2b0474cbe5ba req-ecfb35cb-80ec-4c6c-b60e-ef15f984f683 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received event network-vif-unplugged-95accca5-a977-4d47-964f-57e8451d9cfb for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:55:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Instance destroyed successfully.
Aug 16 10:55:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lazy-loading 'resources' on Instance uuid f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1284292008',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1284292008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1284292',id=39,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4ibWyM6ZeKoLVeRNwk7nH6lFTgdMRkgVuzYTOQ2RreGeEJHFwENwoDi3iKX42nzR+rwfRPo+e0BbA+aJ8FNjxrs3VJwa/rDnWLS1Om6tJ9BVdeVv8YBSN962wBqzOefw==',key_name='tempest-keypair-1944730387',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:52:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cf55c7e83e8401ba10efb3d6bcf234a',ramdisk_id='',reservation_id='r-qqzvrotj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-653345736',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:52:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3bc17160eb542d7bdf352de868da8ab',uuid=f00a4fba-26b6-4f2f-85d7-fc4e4423edb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Converting VIF {"id": "95accca5-a977-4d47-964f-57e8451d9cfb", "address": "fa:16:3e:79:c1:d5", "network": {"id": "fe72448a-4153-4dd3-8ff1-68a86b2d6258", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1449426551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cf55c7e83e8401ba10efb3d6bcf234a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95accca5-a9", "ovs_interfaceid": "95accca5-a977-4d47-964f-57e8451d9cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:c1:d5,bridge_name='br-int',has_traffic_filtering=True,id=95accca5-a977-4d47-964f-57e8451d9cfb,network=Network(fe72448a-4153-4dd3-8ff1-68a86b2d6258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95accca5-a9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG os_vif [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:c1:d5,bridge_name='br-int',has_traffic_filtering=True,id=95accca5-a977-4d47-964f-57e8451d9cfb,network=Network(fe72448a-4153-4dd3-8ff1-68a86b2d6258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95accca5-a9') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95accca5-a9, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:39 user nova-compute[73067]: INFO os_vif [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:c1:d5,bridge_name='br-int',has_traffic_filtering=True,id=95accca5-a977-4d47-964f-57e8451d9cfb,network=Network(fe72448a-4153-4dd3-8ff1-68a86b2d6258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95accca5-a9')
Aug 16 10:55:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Deleting instance files /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1_del
Aug 16 10:55:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Deletion of /opt/stack/data/nova/instances/f00a4fba-26b6-4f2f-85d7-fc4e4423edb1_del complete
Aug 16 10:55:40 user nova-compute[73067]: INFO nova.compute.manager [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 10:55:40 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:55:40 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:55:40 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:55:40 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:55:40 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Took 0.77 seconds to deallocate network for instance.
Aug 16 10:55:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-9aad5756-1030-4213-81ff-ba3db7009675 req-f980be8c-9d7c-49d1-a46c-5cb52ee53c8f service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received event network-vif-deleted-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:40 user nova-compute[73067]: INFO nova.compute.manager [req-9aad5756-1030-4213-81ff-ba3db7009675 req-f980be8c-9d7c-49d1-a46c-5cb52ee53c8f service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Neutron deleted interface 95accca5-a977-4d47-964f-57e8451d9cfb; detaching it from the instance and deleting it from the info cache
Aug 16 10:55:40 user nova-compute[73067]: DEBUG nova.network.neutron [req-9aad5756-1030-4213-81ff-ba3db7009675 req-f980be8c-9d7c-49d1-a46c-5cb52ee53c8f service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:55:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-9aad5756-1030-4213-81ff-ba3db7009675 req-f980be8c-9d7c-49d1-a46c-5cb52ee53c8f service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Detach interface failed, port_id=95accca5-a977-4d47-964f-57e8451d9cfb, reason: Instance f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:55:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:40 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:55:41 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:55:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:41 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Deleted allocations for instance f00a4fba-26b6-4f2f-85d7-fc4e4423edb1
Aug 16 10:55:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-25300428-8a4b-49ee-87f9-241f5564886d tempest-TestServerVolumeAttachScenarioOldVersion-653345736 tempest-TestServerVolumeAttachScenarioOldVersion-653345736-project-member] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.021s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-51926956-55c1-4fb4-b30a-fbd55e8f75f5 req-7685035a-8a76-4883-b209-bc6c6fdebf33 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received event network-vif-plugged-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-51926956-55c1-4fb4-b30a-fbd55e8f75f5 req-7685035a-8a76-4883-b209-bc6c6fdebf33 service nova] Acquiring lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-51926956-55c1-4fb4-b30a-fbd55e8f75f5 req-7685035a-8a76-4883-b209-bc6c6fdebf33 service nova] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-51926956-55c1-4fb4-b30a-fbd55e8f75f5 req-7685035a-8a76-4883-b209-bc6c6fdebf33 service nova] Lock "f00a4fba-26b6-4f2f-85d7-fc4e4423edb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-51926956-55c1-4fb4-b30a-fbd55e8f75f5 req-7685035a-8a76-4883-b209-bc6c6fdebf33 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] No waiting events found dispatching network-vif-plugged-95accca5-a977-4d47-964f-57e8451d9cfb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:55:41 user nova-compute[73067]: WARNING nova.compute.manager [req-51926956-55c1-4fb4-b30a-fbd55e8f75f5 req-7685035a-8a76-4883-b209-bc6c6fdebf33 service nova] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Received unexpected event network-vif-plugged-95accca5-a977-4d47-964f-57e8451d9cfb for instance with vm_state deleted and task_state None.
Aug 16 10:55:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 10:55:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:48 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183335.572867, 5270141d-006f-4349-b919-ab3f1b395754 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:55:50 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 5270141d-006f-4349-b919-ab3f1b395754] VM Stopped (Lifecycle Event)
Aug 16 10:55:50 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:55:50 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8416MB free_disk=25.125167846679688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4907e618-787f-48a1-acdf-57b8f2bcc041 None None] [instance: 5270141d-006f-4349-b919-ab3f1b395754] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Applying migration context for instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e as it has an incoming, in-progress migration 859c652e-83f3-407e-b777-fc83695846b4. Migration status is finished {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 10:55:50 user nova-compute[73067]: INFO nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating resource usage from migration 859c652e-83f3-407e-b777-fc83695846b4
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 80c5b266-d257-447f-9c43-49e9a5455aef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Migration 859c652e-83f3-407e-b777-fc83695846b4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=23GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:55:50 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:55:51 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:55:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updating instance_info_cache with network_info: [{"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-80c5b266-d257-447f-9c43-49e9a5455aef" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183339.899648, f00a4fba-26b6-4f2f-85d7-fc4e4423edb1 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:55:54 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] VM Stopped (Lifecycle Event)
Aug 16 10:55:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1238e18f-a5a9-4096-8d94-f417491958e5 None None] [instance: f00a4fba-26b6-4f2f-85d7-fc4e4423edb1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:55:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:55 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:55 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:55:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:55:57 user nova-compute[73067]: DEBUG nova.network.neutron [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Port 8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb binding to destination host user is already ACTIVE {{(pid=73067) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 10:55:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:55:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquired lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:55:57 user nova-compute[73067]: DEBUG nova.network.neutron [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:55:57 user nova-compute[73067]: DEBUG nova.network.neutron [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance_info_cache with network_info: [{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:55:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Releasing lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:55:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Creating tmpfile /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/tmp5mmslyfl to verify with other compute node that the instance is on the same shared storage. {{(pid=73067) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 16 10:55:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-b1efd151-78b9-4fae-9030-5ae8d62521f8 req-3a86ebda-8d78-4ca1-8d96-f73744b31780 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-unplugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b1efd151-78b9-4fae-9030-5ae8d62521f8 req-3a86ebda-8d78-4ca1-8d96-f73744b31780 service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b1efd151-78b9-4fae-9030-5ae8d62521f8 req-3a86ebda-8d78-4ca1-8d96-f73744b31780 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b1efd151-78b9-4fae-9030-5ae8d62521f8 req-3a86ebda-8d78-4ca1-8d96-f73744b31780 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG nova.compute.manager [req-b1efd151-78b9-4fae-9030-5ae8d62521f8 req-3a86ebda-8d78-4ca1-8d96-f73744b31780 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-unplugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:55:58 user nova-compute[73067]: WARNING nova.compute.manager [req-b1efd151-78b9-4fae-9030-5ae8d62521f8 req-3a86ebda-8d78-4ca1-8d96-f73744b31780 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-unplugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state resized and task_state resize_reverting.
Aug 16 10:55:58 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance destroyed successfully.
Aug 16 10:55:58 user nova-compute[73067]: DEBUG nova.objects.instance [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'resources' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-463554452',display_name='tempest-ServerActionsTestOtherB-server-463554452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-463554452',id=37,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy8enApeRn5w4nXD7WPCVzzBNoEPkFBG9nJlwRN/7waOEDMxMNDNxlKwJIIiVsFfVgQ3mgGu5/NIf0JWVMMSGQeHLzR+u6ysEGCe+2qBYt2VQCEd8TlpcOSfKzUrbkTEA==',key_name='tempest-keypair-772909279',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23ae9395e3fe43ff9ca1f7cb0732f821',ramdisk_id='',reservation_id='r-10kef8qy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-462247235',owner_user_name='tempest-ServerActionsTestOtherB-462247235-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd560990aeb43b2baba0c299323db7b',uuid=0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converting VIF {"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_vif [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e8ac84e-9b, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:55:58 user nova-compute[73067]: INFO os_vif [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b')
Aug 16 10:55:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:55:58 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[411751af-a9db-4e5f-a6ce-4ab4ee2e28c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda81112-9e46-4e1c-8af4-732688204366]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:55:58 user nova-compute[73067]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:55:58 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:55:58 user nova-compute[73067]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:55:58 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35447d9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3dd689-482d-45f3-b721-20918d39d95c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d6237a-0527-417b-a4aa-b4cd4cc6bcc7]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e36328-c47a-4d7e-b990-d40991c004ba]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[26042b94-fab3-4518-9d18-ba96264eb0b8]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f59baa-f71e-45b1-a359-e75ee51c714c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:55:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[27792fe3-50c4-472d-8691-d8fa9f72c887]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]
Aug 16 10:55:59 user nova-compute[73067]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.
Aug 16 10:55:59 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4912fe-72e5-4eb4-a931-a626c4707929]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] <== disconnect_volume: return (317ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:55:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG nova.objects.instance [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'migration_context' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.240s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-d3bc48ce-77e0-4590-a86e-8a806116daee req-e2288df9-c67d-4220-a7f2-1532440fa9b9 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d3bc48ce-77e0-4590-a86e-8a806116daee req-e2288df9-c67d-4220-a7f2-1532440fa9b9 service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d3bc48ce-77e0-4590-a86e-8a806116daee req-e2288df9-c67d-4220-a7f2-1532440fa9b9 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d3bc48ce-77e0-4590-a86e-8a806116daee req-e2288df9-c67d-4220-a7f2-1532440fa9b9 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-d3bc48ce-77e0-4590-a86e-8a806116daee req-e2288df9-c67d-4220-a7f2-1532440fa9b9 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:56:00 user nova-compute[73067]: WARNING nova.compute.manager [req-d3bc48ce-77e0-4590-a86e-8a806116daee req-e2288df9-c67d-4220-a7f2-1532440fa9b9 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state resized and task_state resize_reverting.
Aug 16 10:56:00 user nova-compute[73067]: INFO nova.compute.manager [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Swapping old allocation on dict_keys(['7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f']) held by migration 859c652e-83f3-407e-b777-fc83695846b4 for instance
Aug 16 10:56:00 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Overwriting current allocation {'allocations': {'7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 49}}, 'project_id': '23ae9395e3fe43ff9ca1f7cb0732f821', 'user_id': 'ddd560990aeb43b2baba0c299323db7b', 'consumer_generation': 1} on consumer 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquired lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG nova.network.neutron [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:56:00 user nova-compute[73067]: DEBUG nova.network.neutron [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance_info_cache with network_info: [{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Releasing lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG os_brick.utils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae1f6d6-cf2c-4cce-a72c-6c26f3842ce9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd728f1a-3ff0-4a40-9789-7cd211ab2f1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d963b7a9-2619-485e-9afa-3577186109c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[61445998-f55d-4a9d-a85c-63b6df6e45ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:56:01 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:56:01 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[de65629f-b1fc-4e91-99cd-87533ab90a97]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:56:01 user nova-compute[73067]: DEBUG os_brick.utils [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:56:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:04 user nova-compute[73067]: WARNING nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Aug 16 10:56:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "80c5b266-d257-447f-9c43-49e9a5455aef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:04 user nova-compute[73067]: INFO nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 10:56:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "80c5b266-d257-447f-9c43-49e9a5455aef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "80c5b266-d257-447f-9c43-49e9a5455aef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:06 user nova-compute[73067]: INFO nova.compute.manager [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Terminating instance
Aug 16 10:56:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-0a1dc899-9745-4864-a01d-1cfb07986ac9 req-add2815c-8754-4f44-86b7-4c7bf92a0ba9 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0a1dc899-9745-4864-a01d-1cfb07986ac9 req-add2815c-8754-4f44-86b7-4c7bf92a0ba9 service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0a1dc899-9745-4864-a01d-1cfb07986ac9 req-add2815c-8754-4f44-86b7-4c7bf92a0ba9 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0a1dc899-9745-4864-a01d-1cfb07986ac9 req-add2815c-8754-4f44-86b7-4c7bf92a0ba9 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-0a1dc899-9745-4864-a01d-1cfb07986ac9 req-add2815c-8754-4f44-86b7-4c7bf92a0ba9 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:56:06 user nova-compute[73067]: DEBUG nova.compute.manager [req-0a1dc899-9745-4864-a01d-1cfb07986ac9 req-add2815c-8754-4f44-86b7-4c7bf92a0ba9 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-unplugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:07 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Instance destroyed successfully.
Aug 16 10:56:07 user nova-compute[73067]: DEBUG nova.objects.instance [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lazy-loading 'resources' on Instance uuid 80c5b266-d257-447f-9c43-49e9a5455aef {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2105896710',display_name='tempest-ServerRescueNegativeTestJSON-server-2105896710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2105896710',id=27,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:43:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='687a889259b948fa985ce7c9b84b030a',ramdisk_id='',reservation_id='r-enqd2hwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-411494625',owner_user_name='tempest-ServerRescueNegativeTestJSON-411494625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:45:33Z,user_data=None,user_id='735a6aba3e974eb29e45ec3a7aa8c5cc',uuid=80c5b266-d257-447f-9c43-49e9a5455aef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converting VIF {"id": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "address": "fa:16:3e:f7:b2:37", "network": {"id": "161d353c-cfee-4785-ba2a-faeb618db012", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1455197311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "687a889259b948fa985ce7c9b84b030a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4abca0-e5", "ovs_interfaceid": "cd4abca0-e551-48f4-8d79-ce2ca1665dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b2:37,bridge_name='br-int',has_traffic_filtering=True,id=cd4abca0-e551-48f4-8d79-ce2ca1665dde,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4abca0-e5') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG os_vif [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b2:37,bridge_name='br-int',has_traffic_filtering=True,id=cd4abca0-e551-48f4-8d79-ce2ca1665dde,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4abca0-e5') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd4abca0-e5, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:07 user nova-compute[73067]: INFO os_vif [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b2:37,bridge_name='br-int',has_traffic_filtering=True,id=cd4abca0-e551-48f4-8d79-ce2ca1665dde,network=Network(161d353c-cfee-4785-ba2a-faeb618db012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4abca0-e5')
Aug 16 10:56:07 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Deleting instance files /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef_del
Aug 16 10:56:07 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Deletion of /opt/stack/data/nova/instances/80c5b266-d257-447f-9c43-49e9a5455aef_del complete
Aug 16 10:56:07 user nova-compute[73067]: INFO nova.compute.manager [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 10:56:07 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:56:08 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Took 0.62 seconds to deallocate network for instance.
Aug 16 10:56:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-2ce91b2b-9dd3-49d4-826e-ea724d606b2f req-f799154e-4341-4b91-ae9d-166131256521 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-deleted-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:08 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Deleted allocations for instance 80c5b266-d257-447f-9c43-49e9a5455aef
Aug 16 10:56:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-da74ccc5-1f09-4efc-8f28-fe8ab12b0269 tempest-ServerRescueNegativeTestJSON-411494625 tempest-ServerRescueNegativeTestJSON-411494625-project-member] Lock "80c5b266-d257-447f-9c43-49e9a5455aef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-b607a5db-d456-4798-900a-b8d8fcb8a9b1 req-6b4875f8-58a5-4e94-b334-8480dd6cae32 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b607a5db-d456-4798-900a-b8d8fcb8a9b1 req-6b4875f8-58a5-4e94-b334-8480dd6cae32 service nova] Acquiring lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b607a5db-d456-4798-900a-b8d8fcb8a9b1 req-6b4875f8-58a5-4e94-b334-8480dd6cae32 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b607a5db-d456-4798-900a-b8d8fcb8a9b1 req-6b4875f8-58a5-4e94-b334-8480dd6cae32 service nova] Lock "80c5b266-d257-447f-9c43-49e9a5455aef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-b607a5db-d456-4798-900a-b8d8fcb8a9b1 req-6b4875f8-58a5-4e94-b334-8480dd6cae32 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] No waiting events found dispatching network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:56:08 user nova-compute[73067]: WARNING nova.compute.manager [req-b607a5db-d456-4798-900a-b8d8fcb8a9b1 req-6b4875f8-58a5-4e94-b334-8480dd6cae32 service nova] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Received unexpected event network-vif-plugged-cd4abca0-e551-48f4-8d79-ce2ca1665dde for instance with vm_state deleted and task_state None.
Aug 16 10:56:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Starting finish_revert_migration {{(pid=73067) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Start _get_guest_xml network_info=[{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e', 'attached_at': '2023-08-16T10:56:11.000000', 'detached_at': '', 'volume_id': 'c4f99769-c127-45b0-83d9-14eb210a7a79', 'serial': 'c4f99769-c127-45b0-83d9-14eb210a7a79'}, 'delete_on_termination': False, 'attachment_id': 'e2374276-4397-4ae8-9cf5-a3b58d06ff4b', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:56:11 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:56:11 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.objects.instance [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:56:11 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:56:11 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:56:11 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[474c8839-e511-4539-85e7-161fb5a8eb61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:56:11 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[049a9495-b008-433d-a9c6-8775977838c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79] added
Aug 16 10:56:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dd057f-a680-422d-bd01-b8c1d987d4e8]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bd8adc-6b55-442a-864b-3532dc95306e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVPLGThA {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVPLGThA" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[42193c40-543b-4cb8-8b9e-cc5539b773e8]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FVPLGThA'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f81132-f6ee-494f-96d1-0d7b40609e55]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd02b3a-076b-4280-950d-86b666931d0c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:56:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:56:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b3f1f6-705a-401a-8ff6-acbe92065238]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]
Aug 16 10:56:11 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.
Aug 16 10:56:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a12334-77a3-4801-a36e-53b37c9e4725]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd44c3cc-e020-469c-8565-e4baa06a1084]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:56:11 user nova-compute[73067]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:56:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:56:11 user nova-compute[73067]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:56:11 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2fa12a-11a9-4c32-bd7e-515a7a0834ba]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:56:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26562373131623863', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562373131623863', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-463554452',display_name='tempest-ServerActionsTestOtherB-server-463554452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-463554452',id=37,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy8enApeRn5w4nXD7WPCVzzBNoEPkFBG9nJlwRN/7waOEDMxMNDNxlKwJIIiVsFfVgQ3mgGu5/NIf0JWVMMSGQeHLzR+u6ysEGCe+2qBYt2VQCEd8TlpcOSfKzUrbkTEA==',key_name='tempest-keypair-772909279',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23ae9395e3fe43ff9ca1f7cb0732f821',ramdisk_id='',reservation_id='r-10kef8qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-462247235',owner_user_name='tempest-ServerActionsTestOtherB-462247235-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd560990aeb43b2baba0c299323db7b',uuid=0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converting VIF {"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:56:12 user nova-compute[73067]:   <uuid>0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e</uuid>
Aug 16 10:56:12 user nova-compute[73067]:   <name>instance-00000025</name>
Aug 16 10:56:12 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:56:12 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:56:12 user nova-compute[73067]:   <metadata>
Aug 16 10:56:12 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:56:12 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:56:12 user nova-compute[73067]:       <nova:name>tempest-ServerActionsTestOtherB-server-463554452</nova:name>
Aug 16 10:56:12 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:56:11</nova:creationTime>
Aug 16 10:56:12 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:56:12 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:56:12 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:56:12 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:56:12 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:56:12 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:56:12 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:56:12 user nova-compute[73067]:       <nova:owner>
Aug 16 10:56:12 user nova-compute[73067]:         <nova:user uuid="ddd560990aeb43b2baba0c299323db7b">tempest-ServerActionsTestOtherB-462247235-project-member</nova:user>
Aug 16 10:56:12 user nova-compute[73067]:         <nova:project uuid="23ae9395e3fe43ff9ca1f7cb0732f821">tempest-ServerActionsTestOtherB-462247235</nova:project>
Aug 16 10:56:12 user nova-compute[73067]:       </nova:owner>
Aug 16 10:56:12 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:56:12 user nova-compute[73067]:       <nova:ports>
Aug 16 10:56:12 user nova-compute[73067]:         <nova:port uuid="8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb">
Aug 16 10:56:12 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 10:56:12 user nova-compute[73067]:         </nova:port>
Aug 16 10:56:12 user nova-compute[73067]:       </nova:ports>
Aug 16 10:56:12 user nova-compute[73067]:     </nova:instance>
Aug 16 10:56:12 user nova-compute[73067]:   </metadata>
Aug 16 10:56:12 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:56:12 user nova-compute[73067]:     <system>
Aug 16 10:56:12 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:56:12 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:56:12 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:56:12 user nova-compute[73067]:       <entry name="serial">0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e</entry>
Aug 16 10:56:12 user nova-compute[73067]:       <entry name="uuid">0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e</entry>
Aug 16 10:56:12 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:56:12 user nova-compute[73067]:     </system>
Aug 16 10:56:12 user nova-compute[73067]:   </sysinfo>
Aug 16 10:56:12 user nova-compute[73067]:   <os>
Aug 16 10:56:12 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:56:12 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:56:12 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:56:12 user nova-compute[73067]:   </os>
Aug 16 10:56:12 user nova-compute[73067]:   <features>
Aug 16 10:56:12 user nova-compute[73067]:     <acpi/>
Aug 16 10:56:12 user nova-compute[73067]:     <apic/>
Aug 16 10:56:12 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:56:12 user nova-compute[73067]:   </features>
Aug 16 10:56:12 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:56:12 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:56:12 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:56:12 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:56:12 user nova-compute[73067]:   </clock>
Aug 16 10:56:12 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:56:12 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:56:12 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:56:12 user nova-compute[73067]:   </cpu>
Aug 16 10:56:12 user nova-compute[73067]:   <devices>
Aug 16 10:56:12 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:56:12 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:56:12 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk"/>
Aug 16 10:56:12 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:56:12 user nova-compute[73067]:     </disk>
Aug 16 10:56:12 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:56:12 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:56:12 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 10:56:12 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:56:12 user nova-compute[73067]:       <serial>c4f99769-c127-45b0-83d9-14eb210a7a79</serial>
Aug 16 10:56:12 user nova-compute[73067]:     </disk>
Aug 16 10:56:12 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:56:12 user nova-compute[73067]:       <mac address="fa:16:3e:43:1e:eb"/>
Aug 16 10:56:12 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:56:12 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:56:12 user nova-compute[73067]:       <target dev="tap8e8ac84e-9b"/>
Aug 16 10:56:12 user nova-compute[73067]:     </interface>
Aug 16 10:56:12 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:56:12 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/console.log" append="off"/>
Aug 16 10:56:12 user nova-compute[73067]:     </serial>
Aug 16 10:56:12 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:56:12 user nova-compute[73067]:     <video>
Aug 16 10:56:12 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:56:12 user nova-compute[73067]:     </video>
Aug 16 10:56:12 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:56:12 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:56:12 user nova-compute[73067]:     </rng>
Aug 16 10:56:12 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:56:12 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:56:12 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:56:12 user nova-compute[73067]:     </memballoon>
Aug 16 10:56:12 user nova-compute[73067]:   </devices>
Aug 16 10:56:12 user nova-compute[73067]: </domain>
Aug 16 10:56:12 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-463554452',display_name='tempest-ServerActionsTestOtherB-server-463554452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-463554452',id=37,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy8enApeRn5w4nXD7WPCVzzBNoEPkFBG9nJlwRN/7waOEDMxMNDNxlKwJIIiVsFfVgQ3mgGu5/NIf0JWVMMSGQeHLzR+u6ysEGCe+2qBYt2VQCEd8TlpcOSfKzUrbkTEA==',key_name='tempest-keypair-772909279',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23ae9395e3fe43ff9ca1f7cb0732f821',ramdisk_id='',reservation_id='r-10kef8qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-462247235',owner_user_name='tempest-ServerActionsTestOtherB-462247235-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd560990aeb43b2baba0c299323db7b',uuid=0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converting VIF {"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG os_vif [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e8ac84e-9b, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e8ac84e-9b, col_values=(('external_ids', {'iface-id': '8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:1e:eb', 'vm-uuid': '0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:56:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:12 user nova-compute[73067]: INFO os_vif [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b')
Aug 16 10:56:13 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183358.682812, 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:56:13 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] VM Stopped (Lifecycle Event)
Aug 16 10:56:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-262dc1dc-441a-423d-8d32-fcc8e77f6c97 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG nova.compute.manager [req-db7a4aab-ad71-4dc8-981f-0a6890d6c933 req-be23fc3b-51ad-4339-b150-69e38dfcf55c service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-db7a4aab-ad71-4dc8-981f-0a6890d6c933 req-be23fc3b-51ad-4339-b150-69e38dfcf55c service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-db7a4aab-ad71-4dc8-981f-0a6890d6c933 req-be23fc3b-51ad-4339-b150-69e38dfcf55c service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-db7a4aab-ad71-4dc8-981f-0a6890d6c933 req-be23fc3b-51ad-4339-b150-69e38dfcf55c service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG nova.compute.manager [req-db7a4aab-ad71-4dc8-981f-0a6890d6c933 req-be23fc3b-51ad-4339-b150-69e38dfcf55c service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:56:14 user nova-compute[73067]: WARNING nova.compute.manager [req-db7a4aab-ad71-4dc8-981f-0a6890d6c933 req-be23fc3b-51ad-4339-b150-69e38dfcf55c service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state resized and task_state resize_reverting.
Aug 16 10:56:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:16 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183376.2368133, 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:56:16 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] VM Resumed (Lifecycle Event)
Aug 16 10:56:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:56:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance running successfully.
Aug 16 10:56:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] finish_revert_migration finished successfully. {{(pid=73067) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 16 10:56:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:56:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:56:16 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 10:56:16 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183376.2381089, 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:56:16 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] VM Started (Lifecycle Event)
Aug 16 10:56:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:56:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:56:16 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 10:56:16 user nova-compute[73067]: INFO nova.compute.manager [None req-209ca55f-0622-46d3-b894-c4681472e445 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance to original state: 'active'
Aug 16 10:56:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-9851505a-ebd7-418c-a25a-d2aef6d9849c req-83823d66-8b6f-4624-aad7-4199df22f5e2 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:56:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9851505a-ebd7-418c-a25a-d2aef6d9849c req-83823d66-8b6f-4624-aad7-4199df22f5e2 service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9851505a-ebd7-418c-a25a-d2aef6d9849c req-83823d66-8b6f-4624-aad7-4199df22f5e2 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9851505a-ebd7-418c-a25a-d2aef6d9849c req-83823d66-8b6f-4624-aad7-4199df22f5e2 service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-9851505a-ebd7-418c-a25a-d2aef6d9849c req-83823d66-8b6f-4624-aad7-4199df22f5e2 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:56:16 user nova-compute[73067]: WARNING nova.compute.manager [req-9851505a-ebd7-418c-a25a-d2aef6d9849c req-83823d66-8b6f-4624-aad7-4199df22f5e2 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state resized and task_state resize_reverting.
Aug 16 10:56:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 10:56:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 10:56:22 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183367.362136, 80c5b266-d257-447f-9c43-49e9a5455aef => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:56:22 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] VM Stopped (Lifecycle Event)
Aug 16 10:56:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-46929ab5-5640-4801-84d1-1083cc424853 None None] [instance: 80c5b266-d257-447f-9c43-49e9a5455aef] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:56:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:56:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquired lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:56:39 user nova-compute[73067]: DEBUG nova.network.neutron [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:56:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'info_cache' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.network.neutron [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating instance_info_cache with network_info: [{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Releasing lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:56:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance destroyed successfully.
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'resources' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931024664',display_name='tempest-AttachVolumeTestJSON-server-931024664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931024664',id=40,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwOi0yuhbB2aO510hkVHUD++zdxazhPibxi4KrFyYHibznqT8qcPp6KvP4Z430++DMtPTQKBwKnJl6IByJe4QNk+XSBH1FddohuifAEGgtG/fvgScji19DHLcSRW3nNxg==',key_name='tempest-keypair-725300935',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-fk407c2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=e3815a53-0792-4d95-bb08-bb40cf42f1d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_vif [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap213380a9-db, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:56:41 user nova-compute[73067]: INFO os_vif [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db')
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaOPNTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:56:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f671c565-2633-4633-bc8f-89cb2ba2c3d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2943e74c-4a0a-4ba4-8e97-ba00e30fde8a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:56:41 user nova-compute[73067]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:56:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:56:41 user nova-compute[73067]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:56:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35447da9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[494c38e4-8c52-4bd2-8301-c8094bd15c9b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8819a3b7-897f-4798-b60e-3af41e76b7db]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3132c297-3faf-486c-a0de-1d782ed5fa94]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4997a0b-1ceb-42c6-b785-cd326e815555]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9d95d8-3e98-4573-a8d0-7b33051736bb]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4732ef09-cc93-42fb-9c6d-6201de934351]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260]
Aug 16 10:56:41 user nova-compute[73067]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260] successful.
Aug 16 10:56:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f45ebfa-8b70-41a0-a3b9-f3430b149a7a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== disconnect_volume: return (321ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Start _get_guest_xml network_info=[{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaOPNTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e3815a53-0792-4d95-bb08-bb40cf42f1d4', 'attached_at': '', 'detached_at': '', 'volume_id': '4f66228f-ad60-4d57-831b-459040cc17ee', 'serial': '4f66228f-ad60-4d57-831b-459040cc17ee'}, 'delete_on_termination': False, 'attachment_id': '42cb3870-d93a-4df7-9d06-5153a03d0d1f', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'numa_topology' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:41 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:56:41 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'vcpu_model' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaOPNTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:56:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:56:41 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:56:41 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb30e54a-7091-4b5f-80d3-665a3287b517]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:56:41 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ee6366-0df2-4fef-9840-efea8f0bd40b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee] added
Aug 16 10:56:41 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fb768a-e0f0-4add-82da-bb2173f1542c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[627211f5-d2a4-4df5-989b-db0fae89abcb]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaOPNTpB {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaOPNTpB" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8a9b97-0d87-4e9d-897d-5af8422ff2e4]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XaOPNTpB'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbb67be-a7ec-4d7a-b033-15b45017ad44]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[045ef4b5-e28f-4ae8-a4e4-e5ad81868d59]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:56:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:56:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a27b8a-08e0-49b4-83ae-ec4d1370b98c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260]
Aug 16 10:56:42 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260] successful.
Aug 16 10:56:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a8f3c-f6eb-4aa0-a718-30e8e360b294]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3e0a5c-45c0-4a8e-8fd2-a8cb1d20bca8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:56:42 user nova-compute[73067]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:56:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:56:42 user nova-compute[73067]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:56:42 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ef14e1-bb76-4a98-855e-216c2f917d4e]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:56:42 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaOPNTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26539363465323937', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539363465323937', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931024664',display_name='tempest-AttachVolumeTestJSON-server-931024664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931024664',id=40,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwOi0yuhbB2aO510hkVHUD++zdxazhPibxi4KrFyYHibznqT8qcPp6KvP4Z430++DMtPTQKBwKnJl6IByJe4QNk+XSBH1FddohuifAEGgtG/fvgScji19DHLcSRW3nNxg==',key_name='tempest-keypair-725300935',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-fk407c2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=e3815a53-0792-4d95-bb08-bb40cf42f1d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'pci_devices' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:56:43 user nova-compute[73067]:   <uuid>e3815a53-0792-4d95-bb08-bb40cf42f1d4</uuid>
Aug 16 10:56:43 user nova-compute[73067]:   <name>instance-00000028</name>
Aug 16 10:56:43 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:56:43 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:56:43 user nova-compute[73067]:   <metadata>
Aug 16 10:56:43 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:56:43 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:56:43 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeTestJSON-server-931024664</nova:name>
Aug 16 10:56:43 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:56:41</nova:creationTime>
Aug 16 10:56:43 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:56:43 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:56:43 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:56:43 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:56:43 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:56:43 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:56:43 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:56:43 user nova-compute[73067]:       <nova:owner>
Aug 16 10:56:43 user nova-compute[73067]:         <nova:user uuid="4b01dc15c8fa4a569b697670f32f203a">tempest-AttachVolumeTestJSON-1413526745-project-member</nova:user>
Aug 16 10:56:43 user nova-compute[73067]:         <nova:project uuid="6bab7d6d47c14ddc9cfda43e4cf715e5">tempest-AttachVolumeTestJSON-1413526745</nova:project>
Aug 16 10:56:43 user nova-compute[73067]:       </nova:owner>
Aug 16 10:56:43 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:56:43 user nova-compute[73067]:       <nova:ports>
Aug 16 10:56:43 user nova-compute[73067]:         <nova:port uuid="213380a9-db5d-43fa-9330-72618ec45a34">
Aug 16 10:56:43 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 10:56:43 user nova-compute[73067]:         </nova:port>
Aug 16 10:56:43 user nova-compute[73067]:       </nova:ports>
Aug 16 10:56:43 user nova-compute[73067]:     </nova:instance>
Aug 16 10:56:43 user nova-compute[73067]:   </metadata>
Aug 16 10:56:43 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:56:43 user nova-compute[73067]:     <system>
Aug 16 10:56:43 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:56:43 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:56:43 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:56:43 user nova-compute[73067]:       <entry name="serial">e3815a53-0792-4d95-bb08-bb40cf42f1d4</entry>
Aug 16 10:56:43 user nova-compute[73067]:       <entry name="uuid">e3815a53-0792-4d95-bb08-bb40cf42f1d4</entry>
Aug 16 10:56:43 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:56:43 user nova-compute[73067]:     </system>
Aug 16 10:56:43 user nova-compute[73067]:   </sysinfo>
Aug 16 10:56:43 user nova-compute[73067]:   <os>
Aug 16 10:56:43 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:56:43 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:56:43 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:56:43 user nova-compute[73067]:   </os>
Aug 16 10:56:43 user nova-compute[73067]:   <features>
Aug 16 10:56:43 user nova-compute[73067]:     <acpi/>
Aug 16 10:56:43 user nova-compute[73067]:     <apic/>
Aug 16 10:56:43 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:56:43 user nova-compute[73067]:   </features>
Aug 16 10:56:43 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:56:43 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:56:43 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:56:43 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:56:43 user nova-compute[73067]:   </clock>
Aug 16 10:56:43 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:56:43 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:56:43 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:56:43 user nova-compute[73067]:   </cpu>
Aug 16 10:56:43 user nova-compute[73067]:   <devices>
Aug 16 10:56:43 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:56:43 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:56:43 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk"/>
Aug 16 10:56:43 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:56:43 user nova-compute[73067]:     </disk>
Aug 16 10:56:43 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 10:56:43 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:56:43 user nova-compute[73067]:       <source dev="/dev/sdc"/>
Aug 16 10:56:43 user nova-compute[73067]:       <target dev="vdb" bus="virtio"/>
Aug 16 10:56:43 user nova-compute[73067]:       <serial>4f66228f-ad60-4d57-831b-459040cc17ee</serial>
Aug 16 10:56:43 user nova-compute[73067]:     </disk>
Aug 16 10:56:43 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:56:43 user nova-compute[73067]:       <mac address="fa:16:3e:f5:ee:ed"/>
Aug 16 10:56:43 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:56:43 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:56:43 user nova-compute[73067]:       <target dev="tap213380a9-db"/>
Aug 16 10:56:43 user nova-compute[73067]:     </interface>
Aug 16 10:56:43 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:56:43 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/console.log" append="off"/>
Aug 16 10:56:43 user nova-compute[73067]:     </serial>
Aug 16 10:56:43 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:56:43 user nova-compute[73067]:     <video>
Aug 16 10:56:43 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:56:43 user nova-compute[73067]:     </video>
Aug 16 10:56:43 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:56:43 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:56:43 user nova-compute[73067]:     </rng>
Aug 16 10:56:43 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:56:43 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:56:43 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:56:43 user nova-compute[73067]:     </memballoon>
Aug 16 10:56:43 user nova-compute[73067]:   </devices>
Aug 16 10:56:43 user nova-compute[73067]: </domain>
Aug 16 10:56:43 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'trusted_certs' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:56:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Cannot resize image /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'migration_context' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931024664',display_name='tempest-AttachVolumeTestJSON-server-931024664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931024664',id=40,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwOi0yuhbB2aO510hkVHUD++zdxazhPibxi4KrFyYHibznqT8qcPp6KvP4Z430++DMtPTQKBwKnJl6IByJe4QNk+XSBH1FddohuifAEGgtG/fvgScji19DHLcSRW3nNxg==',key_name='tempest-keypair-725300935',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-fk407c2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=e3815a53-0792-4d95-bb08-bb40cf42f1d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG os_vif [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap213380a9-db, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap213380a9-db, col_values=(('external_ids', {'iface-id': '213380a9-db5d-43fa-9330-72618ec45a34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ee:ed', 'vm-uuid': 'e3815a53-0792-4d95-bb08-bb40cf42f1d4'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:56:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:44 user nova-compute[73067]: INFO os_vif [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db')
Aug 16 10:56:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-14915854-b06d-4c9c-9ca7-3af7d187ccb2 req-a02b39b5-f271-4523-995e-df1039c1ebd5 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:56:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-14915854-b06d-4c9c-9ca7-3af7d187ccb2 req-a02b39b5-f271-4523-995e-df1039c1ebd5 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-14915854-b06d-4c9c-9ca7-3af7d187ccb2 req-a02b39b5-f271-4523-995e-df1039c1ebd5 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-14915854-b06d-4c9c-9ca7-3af7d187ccb2 req-a02b39b5-f271-4523-995e-df1039c1ebd5 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-14915854-b06d-4c9c-9ca7-3af7d187ccb2 req-a02b39b5-f271-4523-995e-df1039c1ebd5 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:56:45 user nova-compute[73067]: WARNING nova.compute.manager [req-14915854-b06d-4c9c-9ca7-3af7d187ccb2 req-a02b39b5-f271-4523-995e-df1039c1ebd5 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state stopped and task_state powering-on.
Aug 16 10:56:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:48 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183408.0077171, e3815a53-0792-4d95-bb08-bb40cf42f1d4 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:56:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] VM Resumed (Lifecycle Event)
Aug 16 10:56:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:56:48 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance rebooted successfully.
Aug 16 10:56:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5636121f-e8be-4a0b-a944-9a31c7fcb408 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:56:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:56:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:56:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-656fa1cd-f98d-46d8-9d53-bcdd37f39f62 req-335ad1c3-2fdf-4f02-b6e0-f0c7e89ab300 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:56:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-656fa1cd-f98d-46d8-9d53-bcdd37f39f62 req-335ad1c3-2fdf-4f02-b6e0-f0c7e89ab300 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-656fa1cd-f98d-46d8-9d53-bcdd37f39f62 req-335ad1c3-2fdf-4f02-b6e0-f0c7e89ab300 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-656fa1cd-f98d-46d8-9d53-bcdd37f39f62 req-335ad1c3-2fdf-4f02-b6e0-f0c7e89ab300 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-656fa1cd-f98d-46d8-9d53-bcdd37f39f62 req-335ad1c3-2fdf-4f02-b6e0-f0c7e89ab300 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:56:48 user nova-compute[73067]: WARNING nova.compute.manager [req-656fa1cd-f98d-46d8-9d53-bcdd37f39f62 req-335ad1c3-2fdf-4f02-b6e0-f0c7e89ab300 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state stopped and task_state powering-on.
Aug 16 10:56:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 10:56:48 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183408.0099428, e3815a53-0792-4d95-bb08-bb40cf42f1d4 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:56:48 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] VM Started (Lifecycle Event)
Aug 16 10:56:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:56:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:56:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:56:52 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:56:52 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:56:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8501MB free_disk=25.207870483398438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:56:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:56:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:56:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:56:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:56:53 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 10:56:53 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 10:56:53 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 10:56:53 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 10:56:53 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 10:56:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:53 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:56:53 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:56:53 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:56:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.852s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:55 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:55 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:56:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:56:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:56:55 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:56:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance_info_cache with network_info: [{"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:56:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:56:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:56:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:56:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:56:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 10:56:57 user nova-compute[73067]: INFO nova.compute.claims [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Claim successful on node user
Aug 16 10:56:57 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG nova.network.neutron [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 10:56:57 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 10:56:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 10:56:57 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Creating image(s)
Aug 16 10:56:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "/opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "/opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "/opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.190s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG nova.policy [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef62930951d046ffad4049ed59ab8c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd988eb51a24329bb4c32cf4c2adca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk 1073741824" returned: 0 in 0.057s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Cannot resize image /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG nova.objects.instance [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lazy-loading 'migration_context' on Instance uuid 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Ensure instance console log exists: /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:56:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:56:59 user nova-compute[73067]: DEBUG nova.network.neutron [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Successfully created port: 0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 10:56:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.network.neutron [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Successfully updated port: 0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquired lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.network.neutron [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-ed54f0bc-998b-4fb9-a2db-3fb2c322d6f3 req-56c5d5f0-cac1-4ea2-99b0-137213b3e2e8 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-changed-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-ed54f0bc-998b-4fb9-a2db-3fb2c322d6f3 req-56c5d5f0-cac1-4ea2-99b0-137213b3e2e8 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Refreshing instance network info cache due to event network-changed-0a6f1077-052d-4487-aef7-699aea7f9294. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ed54f0bc-998b-4fb9-a2db-3fb2c322d6f3 req-56c5d5f0-cac1-4ea2-99b0-137213b3e2e8 service nova] Acquiring lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.network.neutron [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.network.neutron [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updating instance_info_cache with network_info: [{"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Releasing lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Instance network_info: |[{"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ed54f0bc-998b-4fb9-a2db-3fb2c322d6f3 req-56c5d5f0-cac1-4ea2-99b0-137213b3e2e8 service nova] Acquired lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.network.neutron [req-ed54f0bc-998b-4fb9-a2db-3fb2c322d6f3 req-56c5d5f0-cac1-4ea2-99b0-137213b3e2e8 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Refreshing network info cache for port 0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Start _get_guest_xml network_info=[{"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 10:57:00 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:57:00 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:56:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-527334621',display_name='tempest-TestServerVolumeAttachmentScenario-server-527334621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-527334621',id=41,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKSirf9eTVQ4KybademB0I41EHgni3vN1aWgaHgTyHbd6kDlv3Z263HIu5AigaQigACmRRArDjBxYMtjZhJvbgLXygwe08uwfH40adEAq/vY/Yf+f4KkarcTk0kQBYj9w==',key_name='tempest-keypair-1463167827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccd988eb51a24329bb4c32cf4c2adca4',ramdisk_id='',reservation_id='r-seihzfrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-934065589',owner_user_name='tempest-TestServerVolumeAttachmentScenario-934065589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:56:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef62930951d046ffad4049ed59ab8c49',uuid=44e09a7a-e366-4483-a3d3-7141c73d31a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Converting VIF {"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6f1077-052d-4487-aef7-699aea7f9294,network=Network(055bf60a-0d4a-408e-b737-ed738cf7b3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6f1077-05') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.objects.instance [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lazy-loading 'pci_devices' on Instance uuid 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 10:57:00 user nova-compute[73067]:   <uuid>44e09a7a-e366-4483-a3d3-7141c73d31a1</uuid>
Aug 16 10:57:00 user nova-compute[73067]:   <name>instance-00000029</name>
Aug 16 10:57:00 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 10:57:00 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 10:57:00 user nova-compute[73067]:   <metadata>
Aug 16 10:57:00 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 10:57:00 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 10:57:00 user nova-compute[73067]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-527334621</nova:name>
Aug 16 10:57:00 user nova-compute[73067]:       <nova:creationTime>2023-08-16 10:57:00</nova:creationTime>
Aug 16 10:57:00 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 10:57:00 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 10:57:00 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 10:57:00 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 10:57:00 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 10:57:00 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 10:57:00 user nova-compute[73067]:       </nova:flavor>
Aug 16 10:57:00 user nova-compute[73067]:       <nova:owner>
Aug 16 10:57:00 user nova-compute[73067]:         <nova:user uuid="ef62930951d046ffad4049ed59ab8c49">tempest-TestServerVolumeAttachmentScenario-934065589-project-member</nova:user>
Aug 16 10:57:00 user nova-compute[73067]:         <nova:project uuid="ccd988eb51a24329bb4c32cf4c2adca4">tempest-TestServerVolumeAttachmentScenario-934065589</nova:project>
Aug 16 10:57:00 user nova-compute[73067]:       </nova:owner>
Aug 16 10:57:00 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 10:57:00 user nova-compute[73067]:       <nova:ports>
Aug 16 10:57:00 user nova-compute[73067]:         <nova:port uuid="0a6f1077-052d-4487-aef7-699aea7f9294">
Aug 16 10:57:00 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 10:57:00 user nova-compute[73067]:         </nova:port>
Aug 16 10:57:00 user nova-compute[73067]:       </nova:ports>
Aug 16 10:57:00 user nova-compute[73067]:     </nova:instance>
Aug 16 10:57:00 user nova-compute[73067]:   </metadata>
Aug 16 10:57:00 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 10:57:00 user nova-compute[73067]:     <system>
Aug 16 10:57:00 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 10:57:00 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 10:57:00 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 10:57:00 user nova-compute[73067]:       <entry name="serial">44e09a7a-e366-4483-a3d3-7141c73d31a1</entry>
Aug 16 10:57:00 user nova-compute[73067]:       <entry name="uuid">44e09a7a-e366-4483-a3d3-7141c73d31a1</entry>
Aug 16 10:57:00 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 10:57:00 user nova-compute[73067]:     </system>
Aug 16 10:57:00 user nova-compute[73067]:   </sysinfo>
Aug 16 10:57:00 user nova-compute[73067]:   <os>
Aug 16 10:57:00 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 10:57:00 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 10:57:00 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 10:57:00 user nova-compute[73067]:   </os>
Aug 16 10:57:00 user nova-compute[73067]:   <features>
Aug 16 10:57:00 user nova-compute[73067]:     <acpi/>
Aug 16 10:57:00 user nova-compute[73067]:     <apic/>
Aug 16 10:57:00 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 10:57:00 user nova-compute[73067]:   </features>
Aug 16 10:57:00 user nova-compute[73067]:   <clock offset="utc">
Aug 16 10:57:00 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 10:57:00 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 10:57:00 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 10:57:00 user nova-compute[73067]:   </clock>
Aug 16 10:57:00 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 10:57:00 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 10:57:00 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 10:57:00 user nova-compute[73067]:   </cpu>
Aug 16 10:57:00 user nova-compute[73067]:   <devices>
Aug 16 10:57:00 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 10:57:00 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 10:57:00 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk"/>
Aug 16 10:57:00 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 10:57:00 user nova-compute[73067]:     </disk>
Aug 16 10:57:00 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 10:57:00 user nova-compute[73067]:       <mac address="fa:16:3e:9d:e8:10"/>
Aug 16 10:57:00 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:57:00 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 10:57:00 user nova-compute[73067]:       <target dev="tap0a6f1077-05"/>
Aug 16 10:57:00 user nova-compute[73067]:     </interface>
Aug 16 10:57:00 user nova-compute[73067]:     <serial type="pty">
Aug 16 10:57:00 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/console.log" append="off"/>
Aug 16 10:57:00 user nova-compute[73067]:     </serial>
Aug 16 10:57:00 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 10:57:00 user nova-compute[73067]:     <video>
Aug 16 10:57:00 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 10:57:00 user nova-compute[73067]:     </video>
Aug 16 10:57:00 user nova-compute[73067]:     <rng model="virtio">
Aug 16 10:57:00 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 10:57:00 user nova-compute[73067]:     </rng>
Aug 16 10:57:00 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 10:57:00 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 10:57:00 user nova-compute[73067]:       <stats period="10"/>
Aug 16 10:57:00 user nova-compute[73067]:     </memballoon>
Aug 16 10:57:00 user nova-compute[73067]:   </devices>
Aug 16 10:57:00 user nova-compute[73067]: </domain>
Aug 16 10:57:00 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:56:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-527334621',display_name='tempest-TestServerVolumeAttachmentScenario-server-527334621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-527334621',id=41,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKSirf9eTVQ4KybademB0I41EHgni3vN1aWgaHgTyHbd6kDlv3Z263HIu5AigaQigACmRRArDjBxYMtjZhJvbgLXygwe08uwfH40adEAq/vY/Yf+f4KkarcTk0kQBYj9w==',key_name='tempest-keypair-1463167827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccd988eb51a24329bb4c32cf4c2adca4',ramdisk_id='',reservation_id='r-seihzfrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-934065589',owner_user_name='tempest-TestServerVolumeAttachmentScenario-934065589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:56:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef62930951d046ffad4049ed59ab8c49',uuid=44e09a7a-e366-4483-a3d3-7141c73d31a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Converting VIF {"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6f1077-052d-4487-aef7-699aea7f9294,network=Network(055bf60a-0d4a-408e-b737-ed738cf7b3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6f1077-05') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG os_vif [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6f1077-052d-4487-aef7-699aea7f9294,network=Network(055bf60a-0d4a-408e-b737-ed738cf7b3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6f1077-05') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a6f1077-05, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a6f1077-05, col_values=(('external_ids', {'iface-id': '0a6f1077-052d-4487-aef7-699aea7f9294', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:e8:10', 'vm-uuid': '44e09a7a-e366-4483-a3d3-7141c73d31a1'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:00 user nova-compute[73067]: INFO os_vif [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6f1077-052d-4487-aef7-699aea7f9294,network=Network(055bf60a-0d4a-408e-b737-ed738cf7b3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6f1077-05')
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:57:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] No VIF found with MAC fa:16:3e:9d:e8:10, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:57:01 user nova-compute[73067]: DEBUG nova.network.neutron [req-ed54f0bc-998b-4fb9-a2db-3fb2c322d6f3 req-56c5d5f0-cac1-4ea2-99b0-137213b3e2e8 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updated VIF entry in instance network info cache for port 0a6f1077-052d-4487-aef7-699aea7f9294. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:57:01 user nova-compute[73067]: DEBUG nova.network.neutron [req-ed54f0bc-998b-4fb9-a2db-3fb2c322d6f3 req-56c5d5f0-cac1-4ea2-99b0-137213b3e2e8 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updating instance_info_cache with network_info: [{"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:57:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ed54f0bc-998b-4fb9-a2db-3fb2c322d6f3 req-56c5d5f0-cac1-4ea2-99b0-137213b3e2e8 service nova] Releasing lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:57:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-bc5f4082-050c-4839-9ffe-ef41bfb75ad9 req-5ebb5066-ddca-4148-b06b-e2f372486e1b service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:57:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bc5f4082-050c-4839-9ffe-ef41bfb75ad9 req-5ebb5066-ddca-4148-b06b-e2f372486e1b service nova] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:57:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bc5f4082-050c-4839-9ffe-ef41bfb75ad9 req-5ebb5066-ddca-4148-b06b-e2f372486e1b service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:57:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bc5f4082-050c-4839-9ffe-ef41bfb75ad9 req-5ebb5066-ddca-4148-b06b-e2f372486e1b service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:57:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-bc5f4082-050c-4839-9ffe-ef41bfb75ad9 req-5ebb5066-ddca-4148-b06b-e2f372486e1b service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] No waiting events found dispatching network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:57:02 user nova-compute[73067]: WARNING nova.compute.manager [req-bc5f4082-050c-4839-9ffe-ef41bfb75ad9 req-5ebb5066-ddca-4148-b06b-e2f372486e1b service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received unexpected event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 for instance with vm_state building and task_state spawning.
Aug 16 10:57:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183424.6966262, 44e09a7a-e366-4483-a3d3-7141c73d31a1 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:57:04 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] VM Resumed (Lifecycle Event)
Aug 16 10:57:04 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Instance spawned successfully.
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 10:57:04 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183424.6969733, 44e09a7a-e366-4483-a3d3-7141c73d31a1 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:57:04 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] VM Started (Lifecycle Event)
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-28970124-3fcd-4a40-a4f1-d9af5a70a7ae req-4569fcdd-d707-4296-9da0-8ddf25344607 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28970124-3fcd-4a40-a4f1-d9af5a70a7ae req-4569fcdd-d707-4296-9da0-8ddf25344607 service nova] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28970124-3fcd-4a40-a4f1-d9af5a70a7ae req-4569fcdd-d707-4296-9da0-8ddf25344607 service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28970124-3fcd-4a40-a4f1-d9af5a70a7ae req-4569fcdd-d707-4296-9da0-8ddf25344607 service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-28970124-3fcd-4a40-a4f1-d9af5a70a7ae req-4569fcdd-d707-4296-9da0-8ddf25344607 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] No waiting events found dispatching network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:57:04 user nova-compute[73067]: WARNING nova.compute.manager [req-28970124-3fcd-4a40-a4f1-d9af5a70a7ae req-4569fcdd-d707-4296-9da0-8ddf25344607 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received unexpected event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 for instance with vm_state building and task_state spawning.
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:57:04 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 10:57:04 user nova-compute[73067]: INFO nova.compute.manager [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Took 6.87 seconds to spawn the instance on the hypervisor.
Aug 16 10:57:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:57:04 user nova-compute[73067]: INFO nova.compute.manager [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Took 7.52 seconds to build instance.
Aug 16 10:57:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-38a13a48-44b7-4a35-b9b2-8fe874f32e3f tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.661s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:57:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:46 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:57:48 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:57:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:57:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:57:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:57:52 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:57:52 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:57:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8278MB free_disk=25.175312042236328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:57:52 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:57:53 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:57:53 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:57:53 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:57:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:57:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:57:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:57:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:57:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:57:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:57:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating instance_info_cache with network_info: [{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:57:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:57:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:57:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:57:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:57:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:57:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:57:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:57:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:58:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:58:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:31 user nova-compute[73067]: INFO nova.compute.manager [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Detaching volume 4f66228f-ad60-4d57-831b-459040cc17ee
Aug 16 10:58:31 user nova-compute[73067]: INFO nova.virt.block_device [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Attempting to driver detach volume 4f66228f-ad60-4d57-831b-459040cc17ee from mountpoint /dev/vdb
Aug 16 10:58:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Attempting to detach device vdb from instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:58:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:58:31 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:58:31 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:58:31 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:58:31 user nova-compute[73067]:   <serial>4f66228f-ad60-4d57-831b-459040cc17ee</serial>
Aug 16 10:58:31 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 10:58:31 user nova-compute[73067]: </disk>
Aug 16 10:58:31 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:58:31 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully detached device vdb from instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 from the persistent domain config.
Aug 16 10:58:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:58:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:58:31 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:58:31 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:58:31 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:58:31 user nova-compute[73067]:   <serial>4f66228f-ad60-4d57-831b-459040cc17ee</serial>
Aug 16 10:58:31 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 10:58:31 user nova-compute[73067]: </disk>
Aug 16 10:58:31 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692183512.0413787, e3815a53-0792-4d95-bb08-bb40cf42f1d4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:58:32 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully detached device vdb from instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 from the live domain config.
Aug 16 10:58:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaOPNTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:58:32 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b52f40f-50e2-429a-85fc-a770c8fae567]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1e2caa-786e-4473-974b-34e02bc33b3d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:58:32 user nova-compute[73067]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:58:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:58:32 user nova-compute[73067]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee (non-flash)
Aug 16 10:58:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35447f7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1215cd78-533c-4ad5-831f-4ec92dd187a9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e603a34-c5ef-4335-95b1-367c87629075]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0bc2cd-aeb5-4cdb-add6-06fb9e6cc5a5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c29fb4-9b61-4cd4-a17c-ca27331cbf38]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef66fd21-3312-4d3f-804a-d9abfc38bd49]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c390073-ad4b-44d4-81c5-287cace968f6]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260]
Aug 16 10:58:32 user nova-compute[73067]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee, portal: 172.16.0.220,3260] successful.
Aug 16 10:58:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66228f-ad60-4d57-831b-459040cc17ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6259f4c-5a79-4abc-895a-bc747c5886c4]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== disconnect_volume: return (273ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:58:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-dcc71713-f0e0-49c5-b28f-74bd84064eb8 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.635s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1f34ce92-6aeb-4a72-9c54-966207bab228 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1f34ce92-6aeb-4a72-9c54-966207bab228 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1f34ce92-6aeb-4a72-9c54-966207bab228 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1f34ce92-6aeb-4a72-9c54-966207bab228 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73067) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-1f34ce92-6aeb-4a72-9c54-966207bab228 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-87b85d71-b7d7-47f2-a6a4-842f6232edd7 req-5d5caf38-9d81-4d2f-bd16-e60092777417 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-unplugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:58:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-87b85d71-b7d7-47f2-a6a4-842f6232edd7 req-5d5caf38-9d81-4d2f-bd16-e60092777417 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-87b85d71-b7d7-47f2-a6a4-842f6232edd7 req-5d5caf38-9d81-4d2f-bd16-e60092777417 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-87b85d71-b7d7-47f2-a6a4-842f6232edd7 req-5d5caf38-9d81-4d2f-bd16-e60092777417 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:58:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-87b85d71-b7d7-47f2-a6a4-842f6232edd7 req-5d5caf38-9d81-4d2f-bd16-e60092777417 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-unplugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:58:34 user nova-compute[73067]: WARNING nova.compute.manager [req-87b85d71-b7d7-47f2-a6a4-842f6232edd7 req-5d5caf38-9d81-4d2f-bd16-e60092777417 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-unplugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state active and task_state powering-off.
Aug 16 10:58:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance destroyed successfully.
Aug 16 10:58:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-1f34ce92-6aeb-4a72-9c54-966207bab228 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:58:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-1f34ce92-6aeb-4a72-9c54-966207bab228 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.870s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:58:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-9ad6bc49-11c6-4402-84b8-870d99c2150c req-738a720e-29e8-4281-ade5-8ca6b9b2b812 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:58:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9ad6bc49-11c6-4402-84b8-870d99c2150c req-738a720e-29e8-4281-ade5-8ca6b9b2b812 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9ad6bc49-11c6-4402-84b8-870d99c2150c req-738a720e-29e8-4281-ade5-8ca6b9b2b812 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9ad6bc49-11c6-4402-84b8-870d99c2150c req-738a720e-29e8-4281-ade5-8ca6b9b2b812 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:58:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-9ad6bc49-11c6-4402-84b8-870d99c2150c req-738a720e-29e8-4281-ade5-8ca6b9b2b812 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:58:36 user nova-compute[73067]: WARNING nova.compute.manager [req-9ad6bc49-11c6-4402-84b8-870d99c2150c req-738a720e-29e8-4281-ade5-8ca6b9b2b812 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state stopped and task_state None.
Aug 16 10:58:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-dba6d083-f841-42b3-8a7a-929f63593541 req-6af75f24-3bf9-4a5a-942a-436c7d5b83eb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-changed-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-dba6d083-f841-42b3-8a7a-929f63593541 req-6af75f24-3bf9-4a5a-942a-436c7d5b83eb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Refreshing instance network info cache due to event network-changed-0a6f1077-052d-4487-aef7-699aea7f9294. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dba6d083-f841-42b3-8a7a-929f63593541 req-6af75f24-3bf9-4a5a-942a-436c7d5b83eb service nova] Acquiring lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dba6d083-f841-42b3-8a7a-929f63593541 req-6af75f24-3bf9-4a5a-942a-436c7d5b83eb service nova] Acquired lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG nova.network.neutron [req-dba6d083-f841-42b3-8a7a-929f63593541 req-6af75f24-3bf9-4a5a-942a-436c7d5b83eb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Refreshing network info cache for port 0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:58:48 user nova-compute[73067]: INFO nova.compute.manager [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Terminating instance
Aug 16 10:58:48 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:48 user nova-compute[73067]: DEBUG nova.objects.instance [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lazy-loading 'flavor' on Instance uuid 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:49 user nova-compute[73067]: INFO nova.compute.manager [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Attaching volume 751da2ff-30f5-41d1-b7c9-83d9ef0c7575 to /dev/vdb
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.utils [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ed477d-b26b-44eb-84da-635eb01d211d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.network.neutron [req-dba6d083-f841-42b3-8a7a-929f63593541 req-6af75f24-3bf9-4a5a-942a-436c7d5b83eb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updated VIF entry in instance network info cache for port 0a6f1077-052d-4487-aef7-699aea7f9294. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.network.neutron [req-dba6d083-f841-42b3-8a7a-929f63593541 req-6af75f24-3bf9-4a5a-942a-436c7d5b83eb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updating instance_info_cache with network_info: [{"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c254434-c2ab-4f4b-92d4-33d6101f2016]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dba6d083-f841-42b3-8a7a-929f63593541 req-6af75f24-3bf9-4a5a-942a-436c7d5b83eb service nova] Releasing lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e30b618-c4cf-4969-bc35-4cf7a96fcfb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[139f1166-c282-4fb3-9105-531d248d2c8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:58:49 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e68d286-4292-4046-89bd-0110fda42555]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.utils [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updating existing volume attachment record: 5268db53-ede3-454d-b4eb-da4c5f233bd5 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:58:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Instance destroyed successfully.
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.objects.instance [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lazy-loading 'resources' on Instance uuid 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-463554452',display_name='tempest-ServerActionsTestOtherB-server-463554452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-463554452',id=37,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy8enApeRn5w4nXD7WPCVzzBNoEPkFBG9nJlwRN/7waOEDMxMNDNxlKwJIIiVsFfVgQ3mgGu5/NIf0JWVMMSGQeHLzR+u6ysEGCe+2qBYt2VQCEd8TlpcOSfKzUrbkTEA==',key_name='tempest-keypair-772909279',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:56:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23ae9395e3fe43ff9ca1f7cb0732f821',ramdisk_id='',reservation_id='r-10kef8qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-462247235',owner_user_name='tempest-ServerActionsTestOtherB-462247235-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd560990aeb43b2baba0c299323db7b',uuid=0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converting VIF {"id": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "address": "fa:16:3e:43:1e:eb", "network": {"id": "a7c2aa34-08a1-444a-9d0a-dc9b57d73797", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-804741563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ae9395e3fe43ff9ca1f7cb0732f821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8ac84e-9b", "ovs_interfaceid": "8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_vif [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e8ac84e-9b, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:49 user nova-compute[73067]: INFO os_vif [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:1e:eb,bridge_name='br-int',has_traffic_filtering=True,id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb,network=Network(a7c2aa34-08a1-444a-9d0a-dc9b57d73797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8ac84e-9b')
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVPLGThA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:58:49 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183514.5223892, e3815a53-0792-4d95-bb08-bb40cf42f1d4 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:58:49 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] VM Stopped (Lifecycle Event)
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea51c870-8cc8-4653-b28d-129235fed871]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f757f52c-f68e-4e63-bf56-ea343771733e None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f757f52c-f68e-4e63-bf56-ea343771733e None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a707d6e-01e0-4a66-9b9f-7a92d78bf4de]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:58:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 (non-flash)
Aug 16 10:58:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3584297130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae69908b-1c14-45be-8242-7413d0ed254d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[559a947e-969e-414b-aeee-eacd178961e4]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae7ab7a-0aa4-42da-877a-ac21a378ee23]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[841597ed-5b00-48f3-815b-f0aefd876cdb]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[958023d7-23be-45db-8399-37bbf4d91f9c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b95895-40fc-4753-b118-bbb813a3a7cd]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260]
Aug 16 10:58:49 user nova-compute[73067]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79, portal: 172.16.0.220,3260] successful.
Aug 16 10:58:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f99769-c127-45b0-83d9-14eb210a7a79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a5378f-09f2-4df4-90d9-db3e1263f909]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] <== disconnect_volume: return (276ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:58:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Deleting instance files /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e_del
Aug 16 10:58:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Deletion of /opt/stack/data/nova/instances/0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e_del complete
Aug 16 10:58:49 user nova-compute[73067]: INFO nova.compute.manager [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 16 10:58:49 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 10:58:49 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-unplugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-unplugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-unplugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] Acquiring lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:58:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] No waiting events found dispatching network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 10:58:50 user nova-compute[73067]: WARNING nova.compute.manager [req-b2795cfb-dbf2-4772-8af9-d50b27641642 req-2a256ec0-7033-4a25-94d0-5426a108447c service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received unexpected event network-vif-plugged-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb for instance with vm_state active and task_state deleting.
Aug 16 10:58:51 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:58:51 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Took 1.66 seconds to deallocate network for instance.
Aug 16 10:58:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-fd9cae6e-8098-47c3-9b42-66033ca58c3e req-879ea16d-548e-4671-aadc-cd1ba07ac208 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Received event network-vif-deleted-8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 10:58:51 user nova-compute[73067]: INFO nova.compute.manager [req-fd9cae6e-8098-47c3-9b42-66033ca58c3e req-879ea16d-548e-4671-aadc-cd1ba07ac208 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Neutron deleted interface 8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb; detaching it from the instance and deleting it from the info cache
Aug 16 10:58:51 user nova-compute[73067]: DEBUG nova.network.neutron [req-fd9cae6e-8098-47c3-9b42-66033ca58c3e req-879ea16d-548e-4671-aadc-cd1ba07ac208 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:58:51 user nova-compute[73067]: DEBUG nova.compute.manager [req-fd9cae6e-8098-47c3-9b42-66033ca58c3e req-879ea16d-548e-4671-aadc-cd1ba07ac208 service nova] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Detach interface failed, port_id=8e8ac84e-9bc7-4d8c-b0c0-a6e2562e04eb, reason: Instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 10:58:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:53 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:58:54 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:58:54 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:58:54 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8617MB free_disk=25.184932708740234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:58:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:58:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:58:57 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:58:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:58:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 10:58:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Skipping network cache update for instance because it is being deleted. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 16 10:58:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:58:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:58:57 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:58:57 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:58:58 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating instance_info_cache with network_info: [{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:58:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:58:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:58:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:58:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:58:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:58:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 10:58:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:00 user nova-compute[73067]: INFO nova.compute.manager [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Took 8.48 seconds to detach 1 volumes for instance.
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDvFeWGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:59:00 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:59:00 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:59:00 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c330da-2433-4b81-aa26-4d8859e9404a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:59:00 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2d288c-3db1-47d8-9edb-0b6b052c159c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575] added
Aug 16 10:59:00 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe17bec-a97a-4216-8f93-96a751148905]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:00 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Deleted allocations for instance 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4ec2fa-4dd8-4944-923b-5a22ad207f60]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDvFeWGI {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDvFeWGI" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd7c51e-a920-47bb-b3ae-2269029bed22]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LDvFeWGI'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aec818-298d-42b9-ab9d-eb2d4d3cf31c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7ec50a1f-a1fa-4301-930b-5803a47f6cd6 tempest-ServerActionsTestOtherB-462247235 tempest-ServerActionsTestOtherB-462247235-project-member] Lock "0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.885s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9c7e30-f08b-463e-82e5-2c27ec0bba70]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 10:59:00 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 10:59:00 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:59:00 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 10:59:00 user nova-compute[73067]: 
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e49b33-bc2d-497f-bd89-63d8d3910524]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575, portal: 172.16.0.220,3260]
Aug 16 10:59:00 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575, portal: 172.16.0.220,3260] successful.
Aug 16 10:59:00 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1946c8d-f4b8-4a05-92dc-887cc666a793]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e312b395-94fd-4abb-91f8-a6d7146b15ad]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)
Aug 16 10:59:00 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)
Aug 16 10:59:00 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[82504a6e-a36c-4fa3-8029-34b68f154ed4]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:59:00 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDvFeWGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:59:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:59:01 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26133663062316663', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:59:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133663062316663', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:59:01 user nova-compute[73067]: DEBUG nova.objects.instance [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lazy-loading 'flavor' on Instance uuid 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:59:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:59:01 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:59:01 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 10:59:01 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 10:59:01 user nova-compute[73067]:   <serial>751da2ff-30f5-41d1-b7c9-83d9ef0c7575</serial>
Aug 16 10:59:01 user nova-compute[73067]: </disk>
Aug 16 10:59:01 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:59:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:59:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:59:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] No VIF found with MAC fa:16:3e:9d:e8:10, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:59:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-589f26d1-0c15-46e9-a277-9dfe1fa67853 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.973s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:59:04 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183529.4472473, 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 10:59:04 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] VM Stopped (Lifecycle Event)
Aug 16 10:59:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8f94b1c6-b61d-4ba1-9c94-d3214a2baf5f None None] [instance: 0b1ce93a-d135-48ab-bdf1-d5f1ea0f585e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 10:59:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lazy-loading 'flavor' on Instance uuid 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:59:05 user nova-compute[73067]: INFO nova.compute.manager [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Attaching volume 2ab45669-2573-41f6-bff3-d97c08d3ce26 to /dev/vdc
Aug 16 10:59:05 user nova-compute[73067]: DEBUG os_brick.utils [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a1455-501e-4721-8f11-716ec1f673f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c32872-f436-48c2-a2cd-b39821494c4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31af0ce-3159-4dcf-af68-4c59b8e75bd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56162cc-2d87-4b72-a4a4-a471c34fa904]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 10:59:05 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 10:59:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fc329c-8087-4730-ab04-001caf98dc4c]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG os_brick.utils [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:59:05 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updating existing volume attachment record: 71d47b4d-08dc-44a4-b023-4b529f1145b5 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 10:59:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDNAchLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:59:16 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:59:16 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:59:16 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ce2fab-cbb7-4bd5-9bd2-269f9ce8e30a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 10:59:16 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[da30a401-1ab0-4cc4-a73a-0ab56af6e97f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26] added
Aug 16 10:59:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cb22bf-9e42-4497-ba46-2643bfd5c80c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dc0172-01d7-428c-a1c0-281854461e16]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDNAchLU {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDNAchLU" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a60733-bdbf-4bf2-bfd2-8768405cf65c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SDNAchLU'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a51c59-f281-44ed-a785-2d6c238cf43d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4477619c-5ec4-4cb6-a845-40594373cacf]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)
Aug 16 10:59:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)
Aug 16 10:59:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a26a2b-2b26-4a9a-919e-3804e0990724]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26, portal: 172.16.0.220,3260]
Aug 16 10:59:16 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26, portal: 172.16.0.220,3260] successful.
Aug 16 10:59:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dfcbec-2dc5-4c0c-bc8f-d8742249b2bd]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[002587ae-dc64-4ebf-9845-a2bbb23938b6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)
Aug 16 10:59:16 user nova-compute[73067]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 (non-flash)
Aug 16 10:59:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)
Aug 16 10:59:16 user nova-compute[73067]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 (non-flash)
Aug 16 10:59:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8171445-ecfa-4522-96ff-1fb4f9b4b88b]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 10:59:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDNAchLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 10:59:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:59:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26638316566613936', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:59:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638316566613936', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 10:59:17 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lazy-loading 'flavor' on Instance uuid 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:59:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 10:59:17 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:59:17 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:59:17 user nova-compute[73067]:   <target dev="vdc" bus="virtio"/>
Aug 16 10:59:17 user nova-compute[73067]:   <serial>2ab45669-2573-41f6-bff3-d97c08d3ce26</serial>
Aug 16 10:59:17 user nova-compute[73067]: </disk>
Aug 16 10:59:17 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 10:59:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:59:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:59:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 10:59:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] No VIF found with MAC fa:16:3e:9d:e8:10, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 10:59:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0c4fbb6c-00f5-4bae-a3cd-19ed53579ee5 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.506s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:59:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:59:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:59:18 user nova-compute[73067]: INFO nova.compute.manager [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Detaching volume 2ab45669-2573-41f6-bff3-d97c08d3ce26
Aug 16 10:59:18 user nova-compute[73067]: INFO nova.virt.block_device [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Attempting to driver detach volume 2ab45669-2573-41f6-bff3-d97c08d3ce26 from mountpoint /dev/vdc
Aug 16 10:59:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Attempting to detach device vdc from instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 10:59:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:59:18 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:59:18 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:59:18 user nova-compute[73067]:   <target dev="vdc" bus="virtio"/>
Aug 16 10:59:18 user nova-compute[73067]:   <serial>2ab45669-2573-41f6-bff3-d97c08d3ce26</serial>
Aug 16 10:59:18 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 10:59:18 user nova-compute[73067]: </disk>
Aug 16 10:59:18 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:59:18 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Successfully detached device vdc from instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 from the persistent domain config.
Aug 16 10:59:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 10:59:18 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 10:59:18 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 10:59:18 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 10:59:18 user nova-compute[73067]:   <target dev="vdc" bus="virtio"/>
Aug 16 10:59:18 user nova-compute[73067]:   <serial>2ab45669-2573-41f6-bff3-d97c08d3ce26</serial>
Aug 16 10:59:18 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 10:59:18 user nova-compute[73067]: </disk>
Aug 16 10:59:18 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692183559.2467642, 44e09a7a-e366-4483-a3d3-7141c73d31a1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 10:59:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Successfully detached device vdc from instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 from the live domain config.
Aug 16 10:59:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDNAchLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 10:59:19 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0920f2f3-78db-4772-80dd-cb08e8130d00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d838280b-e1e8-4a5c-a42d-edb63a1341a1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)
Aug 16 10:59:19 user nova-compute[73067]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 (non-flash)
Aug 16 10:59:19 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)
Aug 16 10:59:19 user nova-compute[73067]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 (non-flash)
Aug 16 10:59:19 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35447e0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c174976-3030-4265-ac59-6ccec2ffbe19]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e88e549-13d8-4dab-978f-85d11fe9cf41]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9334e0dc-3bab-497d-aeed-877ae8a405ea]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e42f49f-140c-4645-8111-90d086a3ddd3]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5dd2b5-1cdc-4cb3-9fc9-033d46f3350c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da53056-aed4-4227-81b8-012f6b195c87]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26, portal: 172.16.0.220,3260]
Aug 16 10:59:19 user nova-compute[73067]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26, portal: 172.16.0.220,3260] successful.
Aug 16 10:59:19 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab45669-2573-41f6-bff3-d97c08d3ce26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4978c263-98fd-4d5f-ab12-6b5ad08cf913]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] <== disconnect_volume: return (273ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 10:59:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 10:59:20 user nova-compute[73067]: DEBUG nova.objects.instance [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lazy-loading 'flavor' on Instance uuid 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 10:59:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-a85f77da-aa9b-4cb7-952a-b444410204a9 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:59:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:59:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:59:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:59:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:59:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:59:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:59:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 10:59:55 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 10:59:56 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:59:56 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 10:59:56 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8629MB free_disk=25.173175811767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 10:59:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 10:59:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 10:59:56 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:59:56 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 10:59:56 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 10:59:56 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 10:59:56 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 10:59:56 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 10:59:56 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 10:59:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 10:59:57 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:59:57 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 10:59:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 10:59:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 10:59:57 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 10:59:58 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updating instance_info_cache with network_info: [{"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 10:59:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-44e09a7a-e366-4483-a3d3-7141c73d31a1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 10:59:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 10:59:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 10:59:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 10:59:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:00 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:00:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:00:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:00:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:00:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:00:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:00:09 user nova-compute[73067]: INFO nova.compute.manager [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Detaching volume 751da2ff-30f5-41d1-b7c9-83d9ef0c7575
Aug 16 11:00:09 user nova-compute[73067]: INFO nova.virt.block_device [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Attempting to driver detach volume 751da2ff-30f5-41d1-b7c9-83d9ef0c7575 from mountpoint /dev/vdb
Aug 16 11:00:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Attempting to detach device vdb from instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:00:09 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:00:09 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:00:09 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:00:09 user nova-compute[73067]:   <serial>751da2ff-30f5-41d1-b7c9-83d9ef0c7575</serial>
Aug 16 11:00:09 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:00:09 user nova-compute[73067]: </disk>
Aug 16 11:00:09 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:00:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Successfully detached device vdb from instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 from the persistent domain config.
Aug 16 11:00:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:00:09 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:00:09 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:00:09 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:00:09 user nova-compute[73067]:   <serial>751da2ff-30f5-41d1-b7c9-83d9ef0c7575</serial>
Aug 16 11:00:09 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:00:09 user nova-compute[73067]: </disk>
Aug 16 11:00:09 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692183609.8167849, 44e09a7a-e366-4483-a3d3-7141c73d31a1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 11:00:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Successfully detached device vdb from instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 from the live domain config.
Aug 16 11:00:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDvFeWGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:00:09 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2edd49-a9ea-4e86-b39b-741f0dda2bd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[054d9910-d69f-420b-8081-a5fcfd9fb258]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)
Aug 16 11:00:09 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 (non-flash)
Aug 16 11:00:09 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3544727e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f3ddd-2106-46be-9fbc-57c7e6ada509]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4999db3-12e9-4687-9dac-3ac9519242a0]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[474affa2-8bcd-4acd-aff7-717e398c2cde]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c268b24f-000e-4f8f-a896-583cd21331f1]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:00:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0150cd-242d-4943-b65a-bce822b80a0c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c08f8b-7593-42b5-8768-b043b83d7e0d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575, portal: 172.16.0.220,3260]
Aug 16 11:00:10 user nova-compute[73067]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575, portal: 172.16.0.220,3260] successful.
Aug 16 11:00:10 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:751da2ff-30f5-41d1-b7c9-83d9ef0c7575 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb22d94-d022-4087-9817-76ddde105ab0]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] <== disconnect_volume: return (268ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lazy-loading 'flavor' on Instance uuid 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:00:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3d24e150-1469-453a-b2a4-c9da7222b9b2 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:00:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:00:24 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:00:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:00:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquired lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:00:24 user nova-compute[73067]: DEBUG nova.network.neutron [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:00:24 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'info_cache' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:00:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.network.neutron [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating instance_info_cache with network_info: [{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Releasing lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:00:25 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance destroyed successfully.
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'resources' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931024664',display_name='tempest-AttachVolumeTestJSON-server-931024664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931024664',id=40,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwOi0yuhbB2aO510hkVHUD++zdxazhPibxi4KrFyYHibznqT8qcPp6KvP4Z430++DMtPTQKBwKnJl6IByJe4QNk+XSBH1FddohuifAEGgtG/fvgScji19DHLcSRW3nNxg==',key_name='tempest-keypair-725300935',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-fk407c2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=e3815a53-0792-4d95-bb08-bb40cf42f1d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG os_vif [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap213380a9-db, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:00:25 user nova-compute[73067]: INFO os_vif [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db')
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Start _get_guest_xml network_info=[{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'numa_topology' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:00:25 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:00:25 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'vcpu_model' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931024664',display_name='tempest-AttachVolumeTestJSON-server-931024664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931024664',id=40,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwOi0yuhbB2aO510hkVHUD++zdxazhPibxi4KrFyYHibznqT8qcPp6KvP4Z430++DMtPTQKBwKnJl6IByJe4QNk+XSBH1FddohuifAEGgtG/fvgScji19DHLcSRW3nNxg==',key_name='tempest-keypair-725300935',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-fk407c2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=e3815a53-0792-4d95-bb08-bb40cf42f1d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'pci_devices' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:00:25 user nova-compute[73067]:   <uuid>e3815a53-0792-4d95-bb08-bb40cf42f1d4</uuid>
Aug 16 11:00:25 user nova-compute[73067]:   <name>instance-00000028</name>
Aug 16 11:00:25 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:00:25 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:00:25 user nova-compute[73067]:   <metadata>
Aug 16 11:00:25 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:00:25 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:00:25 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeTestJSON-server-931024664</nova:name>
Aug 16 11:00:25 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:00:25</nova:creationTime>
Aug 16 11:00:25 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:00:25 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:00:25 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:00:25 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:00:25 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:00:25 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:00:25 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:00:25 user nova-compute[73067]:       <nova:owner>
Aug 16 11:00:25 user nova-compute[73067]:         <nova:user uuid="4b01dc15c8fa4a569b697670f32f203a">tempest-AttachVolumeTestJSON-1413526745-project-member</nova:user>
Aug 16 11:00:25 user nova-compute[73067]:         <nova:project uuid="6bab7d6d47c14ddc9cfda43e4cf715e5">tempest-AttachVolumeTestJSON-1413526745</nova:project>
Aug 16 11:00:25 user nova-compute[73067]:       </nova:owner>
Aug 16 11:00:25 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 11:00:25 user nova-compute[73067]:       <nova:ports>
Aug 16 11:00:25 user nova-compute[73067]:         <nova:port uuid="213380a9-db5d-43fa-9330-72618ec45a34">
Aug 16 11:00:25 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 11:00:25 user nova-compute[73067]:         </nova:port>
Aug 16 11:00:25 user nova-compute[73067]:       </nova:ports>
Aug 16 11:00:25 user nova-compute[73067]:     </nova:instance>
Aug 16 11:00:25 user nova-compute[73067]:   </metadata>
Aug 16 11:00:25 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:00:25 user nova-compute[73067]:     <system>
Aug 16 11:00:25 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:00:25 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:00:25 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:00:25 user nova-compute[73067]:       <entry name="serial">e3815a53-0792-4d95-bb08-bb40cf42f1d4</entry>
Aug 16 11:00:25 user nova-compute[73067]:       <entry name="uuid">e3815a53-0792-4d95-bb08-bb40cf42f1d4</entry>
Aug 16 11:00:25 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:00:25 user nova-compute[73067]:     </system>
Aug 16 11:00:25 user nova-compute[73067]:   </sysinfo>
Aug 16 11:00:25 user nova-compute[73067]:   <os>
Aug 16 11:00:25 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:00:25 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:00:25 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:00:25 user nova-compute[73067]:   </os>
Aug 16 11:00:25 user nova-compute[73067]:   <features>
Aug 16 11:00:25 user nova-compute[73067]:     <acpi/>
Aug 16 11:00:25 user nova-compute[73067]:     <apic/>
Aug 16 11:00:25 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:00:25 user nova-compute[73067]:   </features>
Aug 16 11:00:25 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:00:25 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:00:25 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:00:25 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:00:25 user nova-compute[73067]:   </clock>
Aug 16 11:00:25 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:00:25 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:00:25 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:00:25 user nova-compute[73067]:   </cpu>
Aug 16 11:00:25 user nova-compute[73067]:   <devices>
Aug 16 11:00:25 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 11:00:25 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 11:00:25 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk"/>
Aug 16 11:00:25 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:00:25 user nova-compute[73067]:     </disk>
Aug 16 11:00:25 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:00:25 user nova-compute[73067]:       <mac address="fa:16:3e:f5:ee:ed"/>
Aug 16 11:00:25 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:00:25 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:00:25 user nova-compute[73067]:       <target dev="tap213380a9-db"/>
Aug 16 11:00:25 user nova-compute[73067]:     </interface>
Aug 16 11:00:25 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:00:25 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/console.log" append="off"/>
Aug 16 11:00:25 user nova-compute[73067]:     </serial>
Aug 16 11:00:25 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:00:25 user nova-compute[73067]:     <video>
Aug 16 11:00:25 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:00:25 user nova-compute[73067]:     </video>
Aug 16 11:00:25 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:00:25 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:00:25 user nova-compute[73067]:     </rng>
Aug 16 11:00:25 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:00:25 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:00:25 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:00:25 user nova-compute[73067]:     </memballoon>
Aug 16 11:00:25 user nova-compute[73067]:   </devices>
Aug 16 11:00:25 user nova-compute[73067]: </domain>
Aug 16 11:00:25 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'trusted_certs' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:00:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Cannot resize image /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'migration_context' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931024664',display_name='tempest-AttachVolumeTestJSON-server-931024664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931024664',id=40,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwOi0yuhbB2aO510hkVHUD++zdxazhPibxi4KrFyYHibznqT8qcPp6KvP4Z430++DMtPTQKBwKnJl6IByJe4QNk+XSBH1FddohuifAEGgtG/fvgScji19DHLcSRW3nNxg==',key_name='tempest-keypair-725300935',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-fk407c2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T10:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=e3815a53-0792-4d95-bb08-bb40cf42f1d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG os_vif [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap213380a9-db, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap213380a9-db, col_values=(('external_ids', {'iface-id': '213380a9-db5d-43fa-9330-72618ec45a34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ee:ed', 'vm-uuid': 'e3815a53-0792-4d95-bb08-bb40cf42f1d4'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:00:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:26 user nova-compute[73067]: INFO os_vif [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db')
Aug 16 11:00:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:28 user nova-compute[73067]: DEBUG nova.compute.manager [req-a5572754-8927-4efe-ac03-848ae5ddaad2 req-7236a885-ae6f-4332-80ce-726d280706c5 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:00:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5572754-8927-4efe-ac03-848ae5ddaad2 req-7236a885-ae6f-4332-80ce-726d280706c5 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:00:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5572754-8927-4efe-ac03-848ae5ddaad2 req-7236a885-ae6f-4332-80ce-726d280706c5 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:00:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5572754-8927-4efe-ac03-848ae5ddaad2 req-7236a885-ae6f-4332-80ce-726d280706c5 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:00:28 user nova-compute[73067]: DEBUG nova.compute.manager [req-a5572754-8927-4efe-ac03-848ae5ddaad2 req-7236a885-ae6f-4332-80ce-726d280706c5 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:00:28 user nova-compute[73067]: WARNING nova.compute.manager [req-a5572754-8927-4efe-ac03-848ae5ddaad2 req-7236a885-ae6f-4332-80ce-726d280706c5 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state stopped and task_state powering-on.
Aug 16 11:00:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:29 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183629.9560385, e3815a53-0792-4d95-bb08-bb40cf42f1d4 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:00:29 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] VM Resumed (Lifecycle Event)
Aug 16 11:00:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:00:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:00:29 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance rebooted successfully.
Aug 16 11:00:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cee6e334-f814-46b2-bdb8-768b4da18335 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:00:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:00:30 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 11:00:30 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183629.960267, e3815a53-0792-4d95-bb08-bb40cf42f1d4 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:00:30 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] VM Started (Lifecycle Event)
Aug 16 11:00:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:00:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:00:30 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 11:00:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-b67cacd6-1989-46a6-a30e-73986c2950cb req-d969461a-948d-48de-90f0-8c1a8c17f297 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:00:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b67cacd6-1989-46a6-a30e-73986c2950cb req-d969461a-948d-48de-90f0-8c1a8c17f297 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:00:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b67cacd6-1989-46a6-a30e-73986c2950cb req-d969461a-948d-48de-90f0-8c1a8c17f297 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:00:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b67cacd6-1989-46a6-a30e-73986c2950cb req-d969461a-948d-48de-90f0-8c1a8c17f297 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:00:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-b67cacd6-1989-46a6-a30e-73986c2950cb req-d969461a-948d-48de-90f0-8c1a8c17f297 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:00:30 user nova-compute[73067]: WARNING nova.compute.manager [req-b67cacd6-1989-46a6-a30e-73986c2950cb req-d969461a-948d-48de-90f0-8c1a8c17f297 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state active and task_state None.
Aug 16 11:00:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating instance_info_cache with network_info: [{"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-e3815a53-0792-4d95-bb08-bb40cf42f1d4" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:00:58 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:00:58 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:00:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8536MB free_disk=25.169891357421875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:00:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:00:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:00:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:00:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:00:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:00:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:00:59 user nova-compute[73067]: INFO nova.compute.manager [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Terminating instance
Aug 16 11:00:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:00:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:00:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-cd5a7d60-35d4-42d5-a8d6-3d4c4d24ae62 req-a1ab34e6-5829-42f8-8780-f05d9b81a1db service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-vif-unplugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-cd5a7d60-35d4-42d5-a8d6-3d4c4d24ae62 req-a1ab34e6-5829-42f8-8780-f05d9b81a1db service nova] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-cd5a7d60-35d4-42d5-a8d6-3d4c4d24ae62 req-a1ab34e6-5829-42f8-8780-f05d9b81a1db service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-cd5a7d60-35d4-42d5-a8d6-3d4c4d24ae62 req-a1ab34e6-5829-42f8-8780-f05d9b81a1db service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-cd5a7d60-35d4-42d5-a8d6-3d4c4d24ae62 req-a1ab34e6-5829-42f8-8780-f05d9b81a1db service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] No waiting events found dispatching network-vif-unplugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-cd5a7d60-35d4-42d5-a8d6-3d4c4d24ae62 req-a1ab34e6-5829-42f8-8780-f05d9b81a1db service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-vif-unplugged-0a6f1077-052d-4487-aef7-699aea7f9294 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Instance destroyed successfully.
Aug 16 11:01:00 user nova-compute[73067]: DEBUG nova.objects.instance [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lazy-loading 'resources' on Instance uuid 44e09a7a-e366-4483-a3d3-7141c73d31a1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:56:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-527334621',display_name='tempest-TestServerVolumeAttachmentScenario-server-527334621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-527334621',id=41,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKSirf9eTVQ4KybademB0I41EHgni3vN1aWgaHgTyHbd6kDlv3Z263HIu5AigaQigACmRRArDjBxYMtjZhJvbgLXygwe08uwfH40adEAq/vY/Yf+f4KkarcTk0kQBYj9w==',key_name='tempest-keypair-1463167827',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccd988eb51a24329bb4c32cf4c2adca4',ramdisk_id='',reservation_id='r-seihzfrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-934065589',owner_user_name='tempest-TestServerVolumeAttachmentScenario-934065589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T10:57:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef62930951d046ffad4049ed59ab8c49',uuid=44e09a7a-e366-4483-a3d3-7141c73d31a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Converting VIF {"id": "0a6f1077-052d-4487-aef7-699aea7f9294", "address": "fa:16:3e:9d:e8:10", "network": {"id": "055bf60a-0d4a-408e-b737-ed738cf7b3a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-177141179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccd988eb51a24329bb4c32cf4c2adca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6f1077-05", "ovs_interfaceid": "0a6f1077-052d-4487-aef7-699aea7f9294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6f1077-052d-4487-aef7-699aea7f9294,network=Network(055bf60a-0d4a-408e-b737-ed738cf7b3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6f1077-05') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG os_vif [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6f1077-052d-4487-aef7-699aea7f9294,network=Network(055bf60a-0d4a-408e-b737-ed738cf7b3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6f1077-05') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a6f1077-05, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:01:00 user nova-compute[73067]: INFO os_vif [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6f1077-052d-4487-aef7-699aea7f9294,network=Network(055bf60a-0d4a-408e-b737-ed738cf7b3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6f1077-05')
Aug 16 11:01:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Deleting instance files /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1_del
Aug 16 11:01:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Deletion of /opt/stack/data/nova/instances/44e09a7a-e366-4483-a3d3-7141c73d31a1_del complete
Aug 16 11:01:00 user nova-compute[73067]: INFO nova.compute.manager [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 11:01:00 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:01:00 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:01:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:01 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:01:01 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Took 1.09 seconds to deallocate network for instance.
Aug 16 11:01:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-a7abc7a3-bbac-4d2b-8b59-dca94bfe821f req-f8fda83f-31b6-4287-b7b0-9a6ab7ea21d1 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-vif-deleted-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:01:01 user nova-compute[73067]: INFO nova.compute.manager [req-a7abc7a3-bbac-4d2b-8b59-dca94bfe821f req-f8fda83f-31b6-4287-b7b0-9a6ab7ea21d1 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Neutron deleted interface 0a6f1077-052d-4487-aef7-699aea7f9294; detaching it from the instance and deleting it from the info cache
Aug 16 11:01:01 user nova-compute[73067]: DEBUG nova.network.neutron [req-a7abc7a3-bbac-4d2b-8b59-dca94bfe821f req-f8fda83f-31b6-4287-b7b0-9a6ab7ea21d1 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:01:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-a7abc7a3-bbac-4d2b-8b59-dca94bfe821f req-f8fda83f-31b6-4287-b7b0-9a6ab7ea21d1 service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Detach interface failed, port_id=0a6f1077-052d-4487-aef7-699aea7f9294, reason: Instance 44e09a7a-e366-4483-a3d3-7141c73d31a1 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 11:01:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] No waiting events found dispatching network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:01:02 user nova-compute[73067]: WARNING nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received unexpected event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 for instance with vm_state deleted and task_state None.
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] No waiting events found dispatching network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:01:02 user nova-compute[73067]: WARNING nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received unexpected event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 for instance with vm_state deleted and task_state None.
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] No waiting events found dispatching network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:01:02 user nova-compute[73067]: WARNING nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received unexpected event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 for instance with vm_state deleted and task_state None.
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-vif-unplugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] No waiting events found dispatching network-vif-unplugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:01:02 user nova-compute[73067]: WARNING nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received unexpected event network-vif-unplugged-0a6f1077-052d-4487-aef7-699aea7f9294 for instance with vm_state deleted and task_state None.
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Acquiring lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] No waiting events found dispatching network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:01:02 user nova-compute[73067]: WARNING nova.compute.manager [req-c1388efe-3ab7-40ab-88b0-e83ee930b401 req-a2a54a6e-3ebd-4bff-a5af-08dabc267bdb service nova] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Received unexpected event network-vif-plugged-0a6f1077-052d-4487-aef7-699aea7f9294 for instance with vm_state deleted and task_state None.
Aug 16 11:01:02 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:02 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Deleted allocations for instance 44e09a7a-e366-4483-a3d3-7141c73d31a1
Aug 16 11:01:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-633e2a3c-7582-45d0-958e-3bfc080bb152 tempest-TestServerVolumeAttachmentScenario-934065589 tempest-TestServerVolumeAttachmentScenario-934065589-project-member] Lock "44e09a7a-e366-4483-a3d3-7141c73d31a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.643s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:03 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:01:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Acquiring lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:01:09 user nova-compute[73067]: INFO nova.compute.claims [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Claim successful on node user
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:01:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.policy [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e977e18d8c94ef7bac9819e147b99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa39c460f314b999b16ccceabc52a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:01:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Creating image(s)
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "/opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "/opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.191s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk 1073741824" returned: 0 in 0.056s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.187s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Successfully created port: 2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Cannot resize image /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lazy-loading 'migration_context' on Instance uuid ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Ensure instance console log exists: /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:01:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Successfully updated port: 2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:01:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Acquiring lock "refresh_cache-ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:01:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Acquired lock "refresh_cache-ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:01:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:01:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:01:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-1916cf28-53ea-4f0e-af34-fe6f8ba7f592 req-db26cb89-30e6-481b-8fc5-1a7b4dc11eb0 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Received event network-changed-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:01:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-1916cf28-53ea-4f0e-af34-fe6f8ba7f592 req-db26cb89-30e6-481b-8fc5-1a7b4dc11eb0 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Refreshing instance network info cache due to event network-changed-2be39eac-a1b0-48b9-8401-d76c8b3cbf00. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:01:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1916cf28-53ea-4f0e-af34-fe6f8ba7f592 req-db26cb89-30e6-481b-8fc5-1a7b4dc11eb0 service nova] Acquiring lock "refresh_cache-ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Updating instance_info_cache with network_info: [{"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Releasing lock "refresh_cache-ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Instance network_info: |[{"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1916cf28-53ea-4f0e-af34-fe6f8ba7f592 req-db26cb89-30e6-481b-8fc5-1a7b4dc11eb0 service nova] Acquired lock "refresh_cache-ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.network.neutron [req-1916cf28-53ea-4f0e-af34-fe6f8ba7f592 req-db26cb89-30e6-481b-8fc5-1a7b4dc11eb0 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Refreshing network info cache for port 2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Start _get_guest_xml network_info=[{"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:01:12 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:01:12 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1363487660',display_name='tempest-VolumesNegativeTest-instance-1363487660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1363487660',id=42,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1aa39c460f314b999b16ccceabc52a20',ramdisk_id='',reservation_id='r-8coadshu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-298036810',owner_user_name='tempest-VolumesNegativeTest-298036810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:01:10Z,user_data=None,user_id='3e977e18d8c94ef7bac9819e147b99ee',uuid=ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Converting VIF {"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:15,bridge_name='br-int',has_traffic_filtering=True,id=2be39eac-a1b0-48b9-8401-d76c8b3cbf00,network=Network(579a408a-8385-49ba-ac36-e20a3cc051d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be39eac-a1') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lazy-loading 'pci_devices' on Instance uuid ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:01:12 user nova-compute[73067]:   <uuid>ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954</uuid>
Aug 16 11:01:12 user nova-compute[73067]:   <name>instance-0000002a</name>
Aug 16 11:01:12 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:01:12 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:01:12 user nova-compute[73067]:   <metadata>
Aug 16 11:01:12 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:01:12 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:01:12 user nova-compute[73067]:       <nova:name>tempest-VolumesNegativeTest-instance-1363487660</nova:name>
Aug 16 11:01:12 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:01:12</nova:creationTime>
Aug 16 11:01:12 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:01:12 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:01:12 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:01:12 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:01:12 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:01:12 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:01:12 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:01:12 user nova-compute[73067]:       <nova:owner>
Aug 16 11:01:12 user nova-compute[73067]:         <nova:user uuid="3e977e18d8c94ef7bac9819e147b99ee">tempest-VolumesNegativeTest-298036810-project-member</nova:user>
Aug 16 11:01:12 user nova-compute[73067]:         <nova:project uuid="1aa39c460f314b999b16ccceabc52a20">tempest-VolumesNegativeTest-298036810</nova:project>
Aug 16 11:01:12 user nova-compute[73067]:       </nova:owner>
Aug 16 11:01:12 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 11:01:12 user nova-compute[73067]:       <nova:ports>
Aug 16 11:01:12 user nova-compute[73067]:         <nova:port uuid="2be39eac-a1b0-48b9-8401-d76c8b3cbf00">
Aug 16 11:01:12 user nova-compute[73067]:           <nova:ip type="fixed" address="192.168.233.123" ipVersion="4"/>
Aug 16 11:01:12 user nova-compute[73067]:         </nova:port>
Aug 16 11:01:12 user nova-compute[73067]:       </nova:ports>
Aug 16 11:01:12 user nova-compute[73067]:     </nova:instance>
Aug 16 11:01:12 user nova-compute[73067]:   </metadata>
Aug 16 11:01:12 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:01:12 user nova-compute[73067]:     <system>
Aug 16 11:01:12 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:01:12 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:01:12 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:01:12 user nova-compute[73067]:       <entry name="serial">ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954</entry>
Aug 16 11:01:12 user nova-compute[73067]:       <entry name="uuid">ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954</entry>
Aug 16 11:01:12 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:01:12 user nova-compute[73067]:     </system>
Aug 16 11:01:12 user nova-compute[73067]:   </sysinfo>
Aug 16 11:01:12 user nova-compute[73067]:   <os>
Aug 16 11:01:12 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:01:12 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:01:12 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:01:12 user nova-compute[73067]:   </os>
Aug 16 11:01:12 user nova-compute[73067]:   <features>
Aug 16 11:01:12 user nova-compute[73067]:     <acpi/>
Aug 16 11:01:12 user nova-compute[73067]:     <apic/>
Aug 16 11:01:12 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:01:12 user nova-compute[73067]:   </features>
Aug 16 11:01:12 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:01:12 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:01:12 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:01:12 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:01:12 user nova-compute[73067]:   </clock>
Aug 16 11:01:12 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:01:12 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:01:12 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:01:12 user nova-compute[73067]:   </cpu>
Aug 16 11:01:12 user nova-compute[73067]:   <devices>
Aug 16 11:01:12 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 11:01:12 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 11:01:12 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk"/>
Aug 16 11:01:12 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:01:12 user nova-compute[73067]:     </disk>
Aug 16 11:01:12 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:01:12 user nova-compute[73067]:       <mac address="fa:16:3e:e3:5c:15"/>
Aug 16 11:01:12 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:01:12 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:01:12 user nova-compute[73067]:       <target dev="tap2be39eac-a1"/>
Aug 16 11:01:12 user nova-compute[73067]:     </interface>
Aug 16 11:01:12 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:01:12 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/console.log" append="off"/>
Aug 16 11:01:12 user nova-compute[73067]:     </serial>
Aug 16 11:01:12 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:01:12 user nova-compute[73067]:     <video>
Aug 16 11:01:12 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:01:12 user nova-compute[73067]:     </video>
Aug 16 11:01:12 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:01:12 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:01:12 user nova-compute[73067]:     </rng>
Aug 16 11:01:12 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:01:12 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:01:12 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:01:12 user nova-compute[73067]:     </memballoon>
Aug 16 11:01:12 user nova-compute[73067]:   </devices>
Aug 16 11:01:12 user nova-compute[73067]: </domain>
Aug 16 11:01:12 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1363487660',display_name='tempest-VolumesNegativeTest-instance-1363487660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1363487660',id=42,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1aa39c460f314b999b16ccceabc52a20',ramdisk_id='',reservation_id='r-8coadshu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-298036810',owner_user_name='tempest-VolumesNegativeTest-298036810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:01:10Z,user_data=None,user_id='3e977e18d8c94ef7bac9819e147b99ee',uuid=ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Converting VIF {"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:15,bridge_name='br-int',has_traffic_filtering=True,id=2be39eac-a1b0-48b9-8401-d76c8b3cbf00,network=Network(579a408a-8385-49ba-ac36-e20a3cc051d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be39eac-a1') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG os_vif [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:15,bridge_name='br-int',has_traffic_filtering=True,id=2be39eac-a1b0-48b9-8401-d76c8b3cbf00,network=Network(579a408a-8385-49ba-ac36-e20a3cc051d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be39eac-a1') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2be39eac-a1, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2be39eac-a1, col_values=(('external_ids', {'iface-id': '2be39eac-a1b0-48b9-8401-d76c8b3cbf00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:5c:15', 'vm-uuid': 'ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:12 user nova-compute[73067]: INFO os_vif [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:15,bridge_name='br-int',has_traffic_filtering=True,id=2be39eac-a1b0-48b9-8401-d76c8b3cbf00,network=Network(579a408a-8385-49ba-ac36-e20a3cc051d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be39eac-a1')
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] No VIF found with MAC fa:16:3e:e3:5c:15, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.network.neutron [req-1916cf28-53ea-4f0e-af34-fe6f8ba7f592 req-db26cb89-30e6-481b-8fc5-1a7b4dc11eb0 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Updated VIF entry in instance network info cache for port 2be39eac-a1b0-48b9-8401-d76c8b3cbf00. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG nova.network.neutron [req-1916cf28-53ea-4f0e-af34-fe6f8ba7f592 req-db26cb89-30e6-481b-8fc5-1a7b4dc11eb0 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Updating instance_info_cache with network_info: [{"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:01:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1916cf28-53ea-4f0e-af34-fe6f8ba7f592 req-db26cb89-30e6-481b-8fc5-1a7b4dc11eb0 service nova] Releasing lock "refresh_cache-ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:01:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:14 user nova-compute[73067]: DEBUG nova.compute.manager [req-cb9835c8-8ef2-43f6-8c48-3c942a3aefd0 req-424910c2-59df-487d-a909-e5192bf9fa0b service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Received event network-vif-plugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:01:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-cb9835c8-8ef2-43f6-8c48-3c942a3aefd0 req-424910c2-59df-487d-a909-e5192bf9fa0b service nova] Acquiring lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-cb9835c8-8ef2-43f6-8c48-3c942a3aefd0 req-424910c2-59df-487d-a909-e5192bf9fa0b service nova] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-cb9835c8-8ef2-43f6-8c48-3c942a3aefd0 req-424910c2-59df-487d-a909-e5192bf9fa0b service nova] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:14 user nova-compute[73067]: DEBUG nova.compute.manager [req-cb9835c8-8ef2-43f6-8c48-3c942a3aefd0 req-424910c2-59df-487d-a909-e5192bf9fa0b service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] No waiting events found dispatching network-vif-plugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:01:14 user nova-compute[73067]: WARNING nova.compute.manager [req-cb9835c8-8ef2-43f6-8c48-3c942a3aefd0 req-424910c2-59df-487d-a909-e5192bf9fa0b service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Received unexpected event network-vif-plugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 for instance with vm_state building and task_state spawning.
Aug 16 11:01:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:15 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183660.5878897, 44e09a7a-e366-4483-a3d3-7141c73d31a1 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:01:15 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] VM Stopped (Lifecycle Event)
Aug 16 11:01:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e30c1441-ac45-45b2-99d8-6f7af9c4fe1a None None] [instance: 44e09a7a-e366-4483-a3d3-7141c73d31a1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183676.200823, ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:01:16 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] VM Resumed (Lifecycle Event)
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:01:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Instance spawned successfully.
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:01:16 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183676.2031717, ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:01:16 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] VM Started (Lifecycle Event)
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:01:16 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:01:16 user nova-compute[73067]: INFO nova.compute.manager [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Took 6.74 seconds to spawn the instance on the hypervisor.
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:01:16 user nova-compute[73067]: INFO nova.compute.manager [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Took 7.31 seconds to build instance.
Aug 16 11:01:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c46-a29c-4669-9a28-6c3dc9434ce9 tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.407s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-4e3f7774-004a-4730-9b9b-398a9ce78a3e req-784ba710-3b4b-411d-9c2b-4f2440a257b8 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Received event network-vif-plugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4e3f7774-004a-4730-9b9b-398a9ce78a3e req-784ba710-3b4b-411d-9c2b-4f2440a257b8 service nova] Acquiring lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4e3f7774-004a-4730-9b9b-398a9ce78a3e req-784ba710-3b4b-411d-9c2b-4f2440a257b8 service nova] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-4e3f7774-004a-4730-9b9b-398a9ce78a3e req-784ba710-3b4b-411d-9c2b-4f2440a257b8 service nova] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-4e3f7774-004a-4730-9b9b-398a9ce78a3e req-784ba710-3b4b-411d-9c2b-4f2440a257b8 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] No waiting events found dispatching network-vif-plugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:01:16 user nova-compute[73067]: WARNING nova.compute.manager [req-4e3f7774-004a-4730-9b9b-398a9ce78a3e req-784ba710-3b4b-411d-9c2b-4f2440a257b8 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Received unexpected event network-vif-plugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 for instance with vm_state active and task_state None.
Aug 16 11:01:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 11:01:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 11:01:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:01:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:01:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:01:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:01:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:01:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:01:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:01:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:01:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:49 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:01:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:01:57 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:01:58 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:01:58 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=25.157821655273438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:01:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:01:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:01:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:01:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:02:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:02:02 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:02:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:02:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:02:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:02:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:02:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:04 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:02:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:02:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:02:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:02:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:02:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:02:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:02:15 user nova-compute[73067]: INFO nova.compute.manager [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Terminating instance
Aug 16 11:02:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:02:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-109e8e3a-d326-495a-96ff-8c2e9ad274b4 req-85af040d-60ae-4dd0-8ab6-f1c27ff23498 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-unplugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-109e8e3a-d326-495a-96ff-8c2e9ad274b4 req-85af040d-60ae-4dd0-8ab6-f1c27ff23498 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-109e8e3a-d326-495a-96ff-8c2e9ad274b4 req-85af040d-60ae-4dd0-8ab6-f1c27ff23498 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-109e8e3a-d326-495a-96ff-8c2e9ad274b4 req-85af040d-60ae-4dd0-8ab6-f1c27ff23498 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-109e8e3a-d326-495a-96ff-8c2e9ad274b4 req-85af040d-60ae-4dd0-8ab6-f1c27ff23498 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-unplugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG nova.compute.manager [req-109e8e3a-d326-495a-96ff-8c2e9ad274b4 req-85af040d-60ae-4dd0-8ab6-f1c27ff23498 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-unplugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:02:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Instance destroyed successfully.
Aug 16 11:02:16 user nova-compute[73067]: DEBUG nova.objects.instance [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'resources' on Instance uuid e3815a53-0792-4d95-bb08-bb40cf42f1d4 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T10:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931024664',display_name='tempest-AttachVolumeTestJSON-server-931024664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931024664',id=40,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwOi0yuhbB2aO510hkVHUD++zdxazhPibxi4KrFyYHibznqT8qcPp6KvP4Z430++DMtPTQKBwKnJl6IByJe4QNk+XSBH1FddohuifAEGgtG/fvgScji19DHLcSRW3nNxg==',key_name='tempest-keypair-725300935',keypairs=<?>,launch_index=0,launched_at=2023-08-16T10:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-fk407c2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=e3815a53-0792-4d95-bb08-bb40cf42f1d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "213380a9-db5d-43fa-9330-72618ec45a34", "address": "fa:16:3e:f5:ee:ed", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213380a9-db", "ovs_interfaceid": "213380a9-db5d-43fa-9330-72618ec45a34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG os_vif [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap213380a9-db, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:02:16 user nova-compute[73067]: INFO os_vif [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ee:ed,bridge_name='br-int',has_traffic_filtering=True,id=213380a9-db5d-43fa-9330-72618ec45a34,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213380a9-db')
Aug 16 11:02:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Deleting instance files /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4_del
Aug 16 11:02:16 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Deletion of /opt/stack/data/nova/instances/e3815a53-0792-4d95-bb08-bb40cf42f1d4_del complete
Aug 16 11:02:16 user nova-compute[73067]: INFO nova.compute.manager [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 16 11:02:16 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:02:16 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:02:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:02:18 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Took 1.42 seconds to deallocate network for instance.
Aug 16 11:02:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-abb23881-1e50-4c0c-b159-57ffeec6a733 req-efdfaebf-353b-49e6-979c-75e54d3a4947 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-deleted-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:02:18 user nova-compute[73067]: INFO nova.compute.manager [req-abb23881-1e50-4c0c-b159-57ffeec6a733 req-efdfaebf-353b-49e6-979c-75e54d3a4947 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Neutron deleted interface 213380a9-db5d-43fa-9330-72618ec45a34; detaching it from the instance and deleting it from the info cache
Aug 16 11:02:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-abb23881-1e50-4c0c-b159-57ffeec6a733 req-efdfaebf-353b-49e6-979c-75e54d3a4947 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-abb23881-1e50-4c0c-b159-57ffeec6a733 req-efdfaebf-353b-49e6-979c-75e54d3a4947 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Detach interface failed, port_id=213380a9-db5d-43fa-9330-72618ec45a34, reason: Instance e3815a53-0792-4d95-bb08-bb40cf42f1d4 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-b02f40d3-924a-4a4a-a1da-63b66a443469 req-24054409-a011-476f-bb2d-94f9296932b9 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b02f40d3-924a-4a4a-a1da-63b66a443469 req-24054409-a011-476f-bb2d-94f9296932b9 service nova] Acquiring lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b02f40d3-924a-4a4a-a1da-63b66a443469 req-24054409-a011-476f-bb2d-94f9296932b9 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b02f40d3-924a-4a4a-a1da-63b66a443469 req-24054409-a011-476f-bb2d-94f9296932b9 service nova] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-b02f40d3-924a-4a4a-a1da-63b66a443469 req-24054409-a011-476f-bb2d-94f9296932b9 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] No waiting events found dispatching network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:02:18 user nova-compute[73067]: WARNING nova.compute.manager [req-b02f40d3-924a-4a4a-a1da-63b66a443469 req-24054409-a011-476f-bb2d-94f9296932b9 service nova] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Received unexpected event network-vif-plugged-213380a9-db5d-43fa-9330-72618ec45a34 for instance with vm_state deleted and task_state None.
Aug 16 11:02:18 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:02:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:02:18 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Deleted allocations for instance e3815a53-0792-4d95-bb08-bb40cf42f1d4
Aug 16 11:02:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-74e130bc-3ea9-410e-a161-2b7d4c3ed37a tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "e3815a53-0792-4d95-bb08-bb40cf42f1d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.545s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:02:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:02:31 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183736.586685, e3815a53-0792-4d95-bb08-bb40cf42f1d4 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:02:31 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] VM Stopped (Lifecycle Event)
Aug 16 11:02:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-62bca350-772b-4197-84f5-4e1f73e3c458 None None] [instance: e3815a53-0792-4d95-bb08-bb40cf42f1d4] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:02:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:02:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:02:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:02:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:02:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:02:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:02:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:50 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:02:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:02:54 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:02:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Updating instance_info_cache with network_info: [{"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:02:58 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:02:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:02:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:02:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Acquiring lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:02:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:02:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Acquiring lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:02:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:02:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:02:59 user nova-compute[73067]: INFO nova.compute.manager [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Terminating instance
Aug 16 11:02:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:02:59 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-e6cd3ea8-f821-409e-915b-c74eaf4d11fa req-cf2c73ce-70b9-4f9a-825a-ff154e91be5e service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Received event network-vif-unplugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e6cd3ea8-f821-409e-915b-c74eaf4d11fa req-cf2c73ce-70b9-4f9a-825a-ff154e91be5e service nova] Acquiring lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e6cd3ea8-f821-409e-915b-c74eaf4d11fa req-cf2c73ce-70b9-4f9a-825a-ff154e91be5e service nova] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e6cd3ea8-f821-409e-915b-c74eaf4d11fa req-cf2c73ce-70b9-4f9a-825a-ff154e91be5e service nova] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-e6cd3ea8-f821-409e-915b-c74eaf4d11fa req-cf2c73ce-70b9-4f9a-825a-ff154e91be5e service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] No waiting events found dispatching network-vif-unplugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-e6cd3ea8-f821-409e-915b-c74eaf4d11fa req-cf2c73ce-70b9-4f9a-825a-ff154e91be5e service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Received event network-vif-unplugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:03:00 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:03:00 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.18364715576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Instance destroyed successfully.
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.objects.instance [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lazy-loading 'resources' on Instance uuid ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1363487660',display_name='tempest-VolumesNegativeTest-instance-1363487660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1363487660',id=42,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:01:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1aa39c460f314b999b16ccceabc52a20',ramdisk_id='',reservation_id='r-8coadshu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-298036810',owner_user_name='tempest-VolumesNegativeTest-298036810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:01:16Z,user_data=None,user_id='3e977e18d8c94ef7bac9819e147b99ee',uuid=ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Converting VIF {"id": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "address": "fa:16:3e:e3:5c:15", "network": {"id": "579a408a-8385-49ba-ac36-e20a3cc051d7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a83b2965d41e4fa79e71b26f13150553", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be39eac-a1", "ovs_interfaceid": "2be39eac-a1b0-48b9-8401-d76c8b3cbf00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5c:15,bridge_name='br-int',has_traffic_filtering=True,id=2be39eac-a1b0-48b9-8401-d76c8b3cbf00,network=Network(579a408a-8385-49ba-ac36-e20a3cc051d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be39eac-a1') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG os_vif [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5c:15,bridge_name='br-int',has_traffic_filtering=True,id=2be39eac-a1b0-48b9-8401-d76c8b3cbf00,network=Network(579a408a-8385-49ba-ac36-e20a3cc051d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be39eac-a1') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2be39eac-a1, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:03:00 user nova-compute[73067]: INFO os_vif [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5c:15,bridge_name='br-int',has_traffic_filtering=True,id=2be39eac-a1b0-48b9-8401-d76c8b3cbf00,network=Network(579a408a-8385-49ba-ac36-e20a3cc051d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be39eac-a1')
Aug 16 11:03:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Deleting instance files /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954_del
Aug 16 11:03:00 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Deletion of /opt/stack/data/nova/instances/ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954_del complete
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:03:00 user nova-compute[73067]: INFO nova.compute.manager [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 16 11:03:00 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:03:00 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Took 0.46 seconds to deallocate network for instance.
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-ecbf0cb2-52a6-4feb-bbcd-1bc13a3e5e86 req-6af5eb57-fd10-4005-b659-ee7b5f4020d6 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Received event network-vif-deleted-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:03:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:00 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Deleted allocations for instance ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954
Aug 16 11:03:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-31798b5d-91be-42e4-add2-2ea72f9809fd tempest-VolumesNegativeTest-298036810 tempest-VolumesNegativeTest-298036810-project-member] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-bab6bf2d-4464-44de-b6ea-94f545ad4c2d req-8686503b-2dc8-4e3b-87ac-784785eaa0c1 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Received event network-vif-plugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:03:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bab6bf2d-4464-44de-b6ea-94f545ad4c2d req-8686503b-2dc8-4e3b-87ac-784785eaa0c1 service nova] Acquiring lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bab6bf2d-4464-44de-b6ea-94f545ad4c2d req-8686503b-2dc8-4e3b-87ac-784785eaa0c1 service nova] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bab6bf2d-4464-44de-b6ea-94f545ad4c2d req-8686503b-2dc8-4e3b-87ac-784785eaa0c1 service nova] Lock "ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:01 user nova-compute[73067]: DEBUG nova.compute.manager [req-bab6bf2d-4464-44de-b6ea-94f545ad4c2d req-8686503b-2dc8-4e3b-87ac-784785eaa0c1 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] No waiting events found dispatching network-vif-plugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:03:01 user nova-compute[73067]: WARNING nova.compute.manager [req-bab6bf2d-4464-44de-b6ea-94f545ad4c2d req-8686503b-2dc8-4e3b-87ac-784785eaa0c1 service nova] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Received unexpected event network-vif-plugged-2be39eac-a1b0-48b9-8401-d76c8b3cbf00 for instance with vm_state deleted and task_state None.
Aug 16 11:03:03 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:03:04 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:03:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:03:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:03:09 user nova-compute[73067]: INFO nova.compute.claims [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Claim successful on node user
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:03:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.policy [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b01dc15c8fa4a569b697670f32f203a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bab7d6d47c14ddc9cfda43e4cf715e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:03:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Creating image(s)
Aug 16 11:03:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "/opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "/opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "/opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:09 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk 1073741824" returned: 0 in 0.197s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.390s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Successfully created port: 82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Cannot resize image /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG nova.objects.instance [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'migration_context' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Ensure instance console log exists: /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Successfully updated port: 82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:03:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:03:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquired lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:03:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:03:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-a8f6a065-86f1-42ec-ab1f-35780bd16fef req-62d92ccb-99e5-487c-b5c9-347e37a1945a service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received event network-changed-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:03:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-a8f6a065-86f1-42ec-ab1f-35780bd16fef req-62d92ccb-99e5-487c-b5c9-347e37a1945a service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Refreshing instance network info cache due to event network-changed-82ec696e-0118-4141-a96f-e31db35877a3. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:03:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a8f6a065-86f1-42ec-ab1f-35780bd16fef req-62d92ccb-99e5-487c-b5c9-347e37a1945a service nova] Acquiring lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:03:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updating instance_info_cache with network_info: [{"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Releasing lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Instance network_info: |[{"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a8f6a065-86f1-42ec-ab1f-35780bd16fef req-62d92ccb-99e5-487c-b5c9-347e37a1945a service nova] Acquired lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.network.neutron [req-a8f6a065-86f1-42ec-ab1f-35780bd16fef req-62d92ccb-99e5-487c-b5c9-347e37a1945a service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Refreshing network info cache for port 82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Start _get_guest_xml network_info=[{"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:03:12 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:03:12 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1646069641',display_name='tempest-AttachVolumeTestJSON-server-1646069641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1646069641',id=43,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnbq/pJVnR5JLm+Q7tjIJ3wNIcHM4IxW5seU7J2Il8sECpmeGI+Bb8LC1xzMWUQ+NNeUUsJ/pJgHQAp9cg/hbZ8atQ6+lSBDa/V8TcOg3yKjVpYVvNW8IfwdTcV8n4jSw==',key_name='tempest-keypair-856414773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-lkjpsnk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:03:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=d57ddae8-029b-4f83-ae60-07c4c1d9279e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:85:70,bridge_name='br-int',has_traffic_filtering=True,id=82ec696e-0118-4141-a96f-e31db35877a3,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ec696e-01') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.objects.instance [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'pci_devices' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:03:12 user nova-compute[73067]:   <uuid>d57ddae8-029b-4f83-ae60-07c4c1d9279e</uuid>
Aug 16 11:03:12 user nova-compute[73067]:   <name>instance-0000002b</name>
Aug 16 11:03:12 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:03:12 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:03:12 user nova-compute[73067]:   <metadata>
Aug 16 11:03:12 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:03:12 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:03:12 user nova-compute[73067]:       <nova:name>tempest-AttachVolumeTestJSON-server-1646069641</nova:name>
Aug 16 11:03:12 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:03:12</nova:creationTime>
Aug 16 11:03:12 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:03:12 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:03:12 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:03:12 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:03:12 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:03:12 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:03:12 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:03:12 user nova-compute[73067]:       <nova:owner>
Aug 16 11:03:12 user nova-compute[73067]:         <nova:user uuid="4b01dc15c8fa4a569b697670f32f203a">tempest-AttachVolumeTestJSON-1413526745-project-member</nova:user>
Aug 16 11:03:12 user nova-compute[73067]:         <nova:project uuid="6bab7d6d47c14ddc9cfda43e4cf715e5">tempest-AttachVolumeTestJSON-1413526745</nova:project>
Aug 16 11:03:12 user nova-compute[73067]:       </nova:owner>
Aug 16 11:03:12 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 11:03:12 user nova-compute[73067]:       <nova:ports>
Aug 16 11:03:12 user nova-compute[73067]:         <nova:port uuid="82ec696e-0118-4141-a96f-e31db35877a3">
Aug 16 11:03:12 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 11:03:12 user nova-compute[73067]:         </nova:port>
Aug 16 11:03:12 user nova-compute[73067]:       </nova:ports>
Aug 16 11:03:12 user nova-compute[73067]:     </nova:instance>
Aug 16 11:03:12 user nova-compute[73067]:   </metadata>
Aug 16 11:03:12 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:03:12 user nova-compute[73067]:     <system>
Aug 16 11:03:12 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:03:12 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:03:12 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:03:12 user nova-compute[73067]:       <entry name="serial">d57ddae8-029b-4f83-ae60-07c4c1d9279e</entry>
Aug 16 11:03:12 user nova-compute[73067]:       <entry name="uuid">d57ddae8-029b-4f83-ae60-07c4c1d9279e</entry>
Aug 16 11:03:12 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:03:12 user nova-compute[73067]:     </system>
Aug 16 11:03:12 user nova-compute[73067]:   </sysinfo>
Aug 16 11:03:12 user nova-compute[73067]:   <os>
Aug 16 11:03:12 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:03:12 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:03:12 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:03:12 user nova-compute[73067]:   </os>
Aug 16 11:03:12 user nova-compute[73067]:   <features>
Aug 16 11:03:12 user nova-compute[73067]:     <acpi/>
Aug 16 11:03:12 user nova-compute[73067]:     <apic/>
Aug 16 11:03:12 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:03:12 user nova-compute[73067]:   </features>
Aug 16 11:03:12 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:03:12 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:03:12 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:03:12 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:03:12 user nova-compute[73067]:   </clock>
Aug 16 11:03:12 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:03:12 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:03:12 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:03:12 user nova-compute[73067]:   </cpu>
Aug 16 11:03:12 user nova-compute[73067]:   <devices>
Aug 16 11:03:12 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 11:03:12 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 11:03:12 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk"/>
Aug 16 11:03:12 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:03:12 user nova-compute[73067]:     </disk>
Aug 16 11:03:12 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:03:12 user nova-compute[73067]:       <mac address="fa:16:3e:a8:85:70"/>
Aug 16 11:03:12 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:03:12 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:03:12 user nova-compute[73067]:       <target dev="tap82ec696e-01"/>
Aug 16 11:03:12 user nova-compute[73067]:     </interface>
Aug 16 11:03:12 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:03:12 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/console.log" append="off"/>
Aug 16 11:03:12 user nova-compute[73067]:     </serial>
Aug 16 11:03:12 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:03:12 user nova-compute[73067]:     <video>
Aug 16 11:03:12 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:03:12 user nova-compute[73067]:     </video>
Aug 16 11:03:12 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:03:12 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:03:12 user nova-compute[73067]:     </rng>
Aug 16 11:03:12 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:03:12 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:03:12 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:03:12 user nova-compute[73067]:     </memballoon>
Aug 16 11:03:12 user nova-compute[73067]:   </devices>
Aug 16 11:03:12 user nova-compute[73067]: </domain>
Aug 16 11:03:12 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1646069641',display_name='tempest-AttachVolumeTestJSON-server-1646069641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1646069641',id=43,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnbq/pJVnR5JLm+Q7tjIJ3wNIcHM4IxW5seU7J2Il8sECpmeGI+Bb8LC1xzMWUQ+NNeUUsJ/pJgHQAp9cg/hbZ8atQ6+lSBDa/V8TcOg3yKjVpYVvNW8IfwdTcV8n4jSw==',key_name='tempest-keypair-856414773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-lkjpsnk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:03:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=d57ddae8-029b-4f83-ae60-07c4c1d9279e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:85:70,bridge_name='br-int',has_traffic_filtering=True,id=82ec696e-0118-4141-a96f-e31db35877a3,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ec696e-01') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG os_vif [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:85:70,bridge_name='br-int',has_traffic_filtering=True,id=82ec696e-0118-4141-a96f-e31db35877a3,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ec696e-01') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82ec696e-01, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82ec696e-01, col_values=(('external_ids', {'iface-id': '82ec696e-0118-4141-a96f-e31db35877a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:85:70', 'vm-uuid': 'd57ddae8-029b-4f83-ae60-07c4c1d9279e'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:12 user nova-compute[73067]: INFO os_vif [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:85:70,bridge_name='br-int',has_traffic_filtering=True,id=82ec696e-0118-4141-a96f-e31db35877a3,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ec696e-01')
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No VIF found with MAC fa:16:3e:a8:85:70, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.network.neutron [req-a8f6a065-86f1-42ec-ab1f-35780bd16fef req-62d92ccb-99e5-487c-b5c9-347e37a1945a service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updated VIF entry in instance network info cache for port 82ec696e-0118-4141-a96f-e31db35877a3. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG nova.network.neutron [req-a8f6a065-86f1-42ec-ab1f-35780bd16fef req-62d92ccb-99e5-487c-b5c9-347e37a1945a service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updating instance_info_cache with network_info: [{"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:03:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a8f6a065-86f1-42ec-ab1f-35780bd16fef req-62d92ccb-99e5-487c-b5c9-347e37a1945a service nova] Releasing lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:03:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-63cddea0-a141-4c7d-97ff-17c797c40040 req-6cca81d8-4405-4e76-b83a-181e398a7d71 service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received event network-vif-plugged-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:03:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-63cddea0-a141-4c7d-97ff-17c797c40040 req-6cca81d8-4405-4e76-b83a-181e398a7d71 service nova] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-63cddea0-a141-4c7d-97ff-17c797c40040 req-6cca81d8-4405-4e76-b83a-181e398a7d71 service nova] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-63cddea0-a141-4c7d-97ff-17c797c40040 req-6cca81d8-4405-4e76-b83a-181e398a7d71 service nova] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:13 user nova-compute[73067]: DEBUG nova.compute.manager [req-63cddea0-a141-4c7d-97ff-17c797c40040 req-6cca81d8-4405-4e76-b83a-181e398a7d71 service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] No waiting events found dispatching network-vif-plugged-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:03:13 user nova-compute[73067]: WARNING nova.compute.manager [req-63cddea0-a141-4c7d-97ff-17c797c40040 req-6cca81d8-4405-4e76-b83a-181e398a7d71 service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received unexpected event network-vif-plugged-82ec696e-0118-4141-a96f-e31db35877a3 for instance with vm_state building and task_state spawning.
Aug 16 11:03:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183779.8513603, ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:03:15 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] VM Stopped (Lifecycle Event)
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-533b39ed-5577-4b3b-883c-cec4dfd3d280 None None] [instance: ac4cf6d4-1c3c-4f43-9a2f-abc0f6876954] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183795.8445227, d57ddae8-029b-4f83-ae60-07c4c1d9279e => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:03:15 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] VM Resumed (Lifecycle Event)
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:03:15 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Instance spawned successfully.
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:03:15 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183795.8466773, d57ddae8-029b-4f83-ae60-07c4c1d9279e => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:03:15 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] VM Started (Lifecycle Event)
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-83555b67-db20-4e2d-bed4-b8d53737615d req-0f4a7fff-5312-48ac-b9f1-970697a0877b service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received event network-vif-plugged-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-83555b67-db20-4e2d-bed4-b8d53737615d req-0f4a7fff-5312-48ac-b9f1-970697a0877b service nova] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-83555b67-db20-4e2d-bed4-b8d53737615d req-0f4a7fff-5312-48ac-b9f1-970697a0877b service nova] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-83555b67-db20-4e2d-bed4-b8d53737615d req-0f4a7fff-5312-48ac-b9f1-970697a0877b service nova] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.compute.manager [req-83555b67-db20-4e2d-bed4-b8d53737615d req-0f4a7fff-5312-48ac-b9f1-970697a0877b service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] No waiting events found dispatching network-vif-plugged-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:03:15 user nova-compute[73067]: WARNING nova.compute.manager [req-83555b67-db20-4e2d-bed4-b8d53737615d req-0f4a7fff-5312-48ac-b9f1-970697a0877b service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received unexpected event network-vif-plugged-82ec696e-0118-4141-a96f-e31db35877a3 for instance with vm_state building and task_state spawning.
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:03:15 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:03:15 user nova-compute[73067]: INFO nova.compute.manager [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 16 11:03:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:03:16 user nova-compute[73067]: INFO nova.compute.manager [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Took 6.50 seconds to build instance.
Aug 16 11:03:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c5aed60c-2bce-473c-a88e-a916055b0b93 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.599s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:03:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:03:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:03:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:03:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:03:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:03:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:03:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:03:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:03:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:03:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:03:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:03:55 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:03:55 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:03:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:03:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:03:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:03:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:03:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:03:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:03:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:03:59 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:03:59 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:03:59 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updating instance_info_cache with network_info: [{"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:03:59 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:03:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:00 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:04:00 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:04:00 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.173404693603516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:04:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:04:01 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance d57ddae8-029b-4f83-ae60-07c4c1d9279e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:04:01 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:04:01 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:04:01 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:04:01 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:04:01 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:04:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:04:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:04 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:04:04 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:04:04 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:04:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:07 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:04:07 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:04:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:04:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:04:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:04:27 user nova-compute[73067]: INFO nova.compute.claims [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Claim successful on node user
Aug 16 11:04:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:04:27 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:04:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:04:27 user nova-compute[73067]: INFO nova.virt.block_device [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Booting with volume 795d47c6-2830-4a6d-812d-27fd0127aaa4 at /dev/vda
Aug 16 11:04:27 user nova-compute[73067]: DEBUG nova.policy [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fccdae9c933a48a2a2750119c0a9cf33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6706c7063ed47a093bf6a015d62e1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG os_brick.utils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b1e6a1-eb67-4800-8e55-72d575fc3b27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e71ddb-c817-476c-b3f3-049998c02379]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9496017e-fac7-4095-979d-27d2a84b6438]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78faf61-847a-4bcc-af25-be7a44a11cf8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:04:27 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:04:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d8be98-d09c-4faf-b22a-5932bf2b772e]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG os_brick.utils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:04:27 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating existing volume attachment record: 9c413d88-4bee-4db9-8d88-e783a63b23e1 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:04:28 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Successfully created port: 946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Successfully updated port: 946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquired lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-98f4bf52-97f5-4a54-b742-3bab5450519c req-9c26d83b-1b35-4e68-b06a-5720247e5c27 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-changed-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-98f4bf52-97f5-4a54-b742-3bab5450519c req-9c26d83b-1b35-4e68-b06a-5720247e5c27 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Refreshing instance network info cache due to event network-changed-946cf489-0604-4bb0-a75c-1f4341fd7c8e. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-98f4bf52-97f5-4a54-b742-3bab5450519c req-9c26d83b-1b35-4e68-b06a-5720247e5c27 service nova] Acquiring lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG nova.network.neutron [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Releasing lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Instance network_info: |[{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-98f4bf52-97f5-4a54-b742-3bab5450519c req-9c26d83b-1b35-4e68-b06a-5720247e5c27 service nova] Acquired lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG nova.network.neutron [req-98f4bf52-97f5-4a54-b742-3bab5450519c req-9c26d83b-1b35-4e68-b06a-5720247e5c27 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Refreshing network info cache for port 946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG nova.network.neutron [req-98f4bf52-97f5-4a54-b742-3bab5450519c req-9c26d83b-1b35-4e68-b06a-5720247e5c27 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updated VIF entry in instance network info cache for port 946cf489-0604-4bb0-a75c-1f4341fd7c8e. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG nova.network.neutron [req-98f4bf52-97f5-4a54-b742-3bab5450519c req-9c26d83b-1b35-4e68-b06a-5720247e5c27 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:04:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-98f4bf52-97f5-4a54-b742-3bab5450519c req-9c26d83b-1b35-4e68-b06a-5720247e5c27 service nova] Releasing lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:04:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:04:37 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Creating image(s)
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Ensure instance console log exists: /opt/stack/data/nova/instances/d9d82a13-233b-465b-ab55-93ec5e5d6a51/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Start _get_guest_xml network_info=[{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmOGwYSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd9d82a13-233b-465b-ab55-93ec5e5d6a51', 'attached_at': '', 'detached_at': '', 'volume_id': '795d47c6-2830-4a6d-812d-27fd0127aaa4', 'serial': '795d47c6-2830-4a6d-812d-27fd0127aaa4'}, 'delete_on_termination': True, 'attachment_id': '9c413d88-4bee-4db9-8d88-e783a63b23e1', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:04:37 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:04:37 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmOGwYSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:04:37 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:04:37 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:04:37 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89329de-a8f7-445d-90fd-804ab6152ba0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:04:37 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24fa9bf-21cf-4607-9cfc-876a21638074]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4] added
Aug 16 11:04:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f16089-8769-4ddf-9298-4953cf6fd635]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4614fd33-5574-4802-b577-860a761a4f3f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmOGwYSy {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmOGwYSy" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2e8294-a683-4c67-8b3b-95cf985e5381]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmOGwYSy'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[003ff0db-702a-4f04-961d-8d166eeecb23]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f033f65-66fe-4ad3-97db-e81564dfa288]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:04:37 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:04:37 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:04:37 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 11:04:37 user nova-compute[73067]: 
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4294ab74-121f-43b2-91bf-b87044e83ec9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260]
Aug 16 11:04:37 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260] successful.
Aug 16 11:04:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[852023a4-295a-486a-a3ab-20a98beaa5f3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622548d-dee9-4dde-8970-3e299efe6e9f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:04:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:04:37 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2422be6f-8275-4584-9521-931b8d525a7b]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:04:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmOGwYSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26438633435323763', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438633435323763', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-822056961',display_name='tempest-TestShelveInstance-server-822056961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-822056961',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuiv0Z3DCYprJ26jun6hgC5OZXZZiklQpEAjHM4zJ6Gsu2mWJkvfcSfb1tEdYYMB8kka5B3e9I6LQ6e/jsLEj22jhRMwy+ppLNlcpVYGHcDAh6pZ+JqJ4Z+Bs6qgYguLA==',key_name='tempest-TestShelveInstance-696161861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6706c7063ed47a093bf6a015d62e1ab',ramdisk_id='',reservation_id='r-0yfrf7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1150615292',owner_user_name='tempest-TestShelveInstance-1150615292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:04:27Z,user_data=None,user_id='fccdae9c933a48a2a2750119c0a9cf33',uuid=d9d82a13-233b-465b-ab55-93ec5e5d6a51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converting VIF {"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG nova.objects.instance [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lazy-loading 'pci_devices' on Instance uuid d9d82a13-233b-465b-ab55-93ec5e5d6a51 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:04:38 user nova-compute[73067]:   <uuid>d9d82a13-233b-465b-ab55-93ec5e5d6a51</uuid>
Aug 16 11:04:38 user nova-compute[73067]:   <name>instance-0000002c</name>
Aug 16 11:04:38 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:04:38 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:04:38 user nova-compute[73067]:   <metadata>
Aug 16 11:04:38 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:04:38 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:04:38 user nova-compute[73067]:       <nova:name>tempest-TestShelveInstance-server-822056961</nova:name>
Aug 16 11:04:38 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:04:37</nova:creationTime>
Aug 16 11:04:38 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:04:38 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:04:38 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:04:38 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:04:38 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:04:38 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:04:38 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:04:38 user nova-compute[73067]:       <nova:owner>
Aug 16 11:04:38 user nova-compute[73067]:         <nova:user uuid="fccdae9c933a48a2a2750119c0a9cf33">tempest-TestShelveInstance-1150615292-project-member</nova:user>
Aug 16 11:04:38 user nova-compute[73067]:         <nova:project uuid="c6706c7063ed47a093bf6a015d62e1ab">tempest-TestShelveInstance-1150615292</nova:project>
Aug 16 11:04:38 user nova-compute[73067]:       </nova:owner>
Aug 16 11:04:38 user nova-compute[73067]:       <nova:ports>
Aug 16 11:04:38 user nova-compute[73067]:         <nova:port uuid="946cf489-0604-4bb0-a75c-1f4341fd7c8e">
Aug 16 11:04:38 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 11:04:38 user nova-compute[73067]:         </nova:port>
Aug 16 11:04:38 user nova-compute[73067]:       </nova:ports>
Aug 16 11:04:38 user nova-compute[73067]:     </nova:instance>
Aug 16 11:04:38 user nova-compute[73067]:   </metadata>
Aug 16 11:04:38 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:04:38 user nova-compute[73067]:     <system>
Aug 16 11:04:38 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:04:38 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:04:38 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:04:38 user nova-compute[73067]:       <entry name="serial">d9d82a13-233b-465b-ab55-93ec5e5d6a51</entry>
Aug 16 11:04:38 user nova-compute[73067]:       <entry name="uuid">d9d82a13-233b-465b-ab55-93ec5e5d6a51</entry>
Aug 16 11:04:38 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:04:38 user nova-compute[73067]:     </system>
Aug 16 11:04:38 user nova-compute[73067]:   </sysinfo>
Aug 16 11:04:38 user nova-compute[73067]:   <os>
Aug 16 11:04:38 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:04:38 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:04:38 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:04:38 user nova-compute[73067]:   </os>
Aug 16 11:04:38 user nova-compute[73067]:   <features>
Aug 16 11:04:38 user nova-compute[73067]:     <acpi/>
Aug 16 11:04:38 user nova-compute[73067]:     <apic/>
Aug 16 11:04:38 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:04:38 user nova-compute[73067]:   </features>
Aug 16 11:04:38 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:04:38 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:04:38 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:04:38 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:04:38 user nova-compute[73067]:   </clock>
Aug 16 11:04:38 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:04:38 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:04:38 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:04:38 user nova-compute[73067]:   </cpu>
Aug 16 11:04:38 user nova-compute[73067]:   <devices>
Aug 16 11:04:38 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 11:04:38 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:04:38 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 11:04:38 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:04:38 user nova-compute[73067]:       <serial>795d47c6-2830-4a6d-812d-27fd0127aaa4</serial>
Aug 16 11:04:38 user nova-compute[73067]:     </disk>
Aug 16 11:04:38 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:04:38 user nova-compute[73067]:       <mac address="fa:16:3e:4e:61:5f"/>
Aug 16 11:04:38 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:04:38 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:04:38 user nova-compute[73067]:       <target dev="tap946cf489-06"/>
Aug 16 11:04:38 user nova-compute[73067]:     </interface>
Aug 16 11:04:38 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:04:38 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/d9d82a13-233b-465b-ab55-93ec5e5d6a51/console.log" append="off"/>
Aug 16 11:04:38 user nova-compute[73067]:     </serial>
Aug 16 11:04:38 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:04:38 user nova-compute[73067]:     <video>
Aug 16 11:04:38 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:04:38 user nova-compute[73067]:     </video>
Aug 16 11:04:38 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:04:38 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:04:38 user nova-compute[73067]:     </rng>
Aug 16 11:04:38 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:04:38 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:04:38 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:04:38 user nova-compute[73067]:     </memballoon>
Aug 16 11:04:38 user nova-compute[73067]:   </devices>
Aug 16 11:04:38 user nova-compute[73067]: </domain>
Aug 16 11:04:38 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-822056961',display_name='tempest-TestShelveInstance-server-822056961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-822056961',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuiv0Z3DCYprJ26jun6hgC5OZXZZiklQpEAjHM4zJ6Gsu2mWJkvfcSfb1tEdYYMB8kka5B3e9I6LQ6e/jsLEj22jhRMwy+ppLNlcpVYGHcDAh6pZ+JqJ4Z+Bs6qgYguLA==',key_name='tempest-TestShelveInstance-696161861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6706c7063ed47a093bf6a015d62e1ab',ramdisk_id='',reservation_id='r-0yfrf7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1150615292',owner_user_name='tempest-TestShelveInstance-1150615292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:04:27Z,user_data=None,user_id='fccdae9c933a48a2a2750119c0a9cf33',uuid=d9d82a13-233b-465b-ab55-93ec5e5d6a51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converting VIF {"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG os_vif [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap946cf489-06, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap946cf489-06, col_values=(('external_ids', {'iface-id': '946cf489-0604-4bb0-a75c-1f4341fd7c8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:61:5f', 'vm-uuid': 'd9d82a13-233b-465b-ab55-93ec5e5d6a51'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:04:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:38 user nova-compute[73067]: INFO os_vif [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06')
Aug 16 11:04:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:04:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] No VIF found with MAC fa:16:3e:4e:61:5f, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:04:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-58c84233-e35b-4694-8e97-445baaba81e8 req-613e98f2-d000-43bd-b963-561ed4aa152b service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:04:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-58c84233-e35b-4694-8e97-445baaba81e8 req-613e98f2-d000-43bd-b963-561ed4aa152b service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:04:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-58c84233-e35b-4694-8e97-445baaba81e8 req-613e98f2-d000-43bd-b963-561ed4aa152b service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:04:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-58c84233-e35b-4694-8e97-445baaba81e8 req-613e98f2-d000-43bd-b963-561ed4aa152b service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:04:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-58c84233-e35b-4694-8e97-445baaba81e8 req-613e98f2-d000-43bd-b963-561ed4aa152b service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:04:40 user nova-compute[73067]: WARNING nova.compute.manager [req-58c84233-e35b-4694-8e97-445baaba81e8 req-613e98f2-d000-43bd-b963-561ed4aa152b service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state building and task_state spawning.
Aug 16 11:04:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183882.2906215, d9d82a13-233b-465b-ab55-93ec5e5d6a51 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:04:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] VM Resumed (Lifecycle Event)
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:04:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Instance spawned successfully.
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:04:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692183882.291919, d9d82a13-233b-465b-ab55-93ec5e5d6a51 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:04:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] VM Started (Lifecycle Event)
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:04:42 user nova-compute[73067]: INFO nova.compute.manager [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Took 4.87 seconds to spawn the instance on the hypervisor.
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:04:42 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:04:42 user nova-compute[73067]: INFO nova.compute.manager [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Took 15.45 seconds to build instance.
Aug 16 11:04:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c531e5a4-d1d0-401d-b510-626b712323ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.546s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9f17aea-76cd-49ac-b65b-c48500fd10f8 req-77556581-768f-42ba-b66a-eae6887df7ce service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f17aea-76cd-49ac-b65b-c48500fd10f8 req-77556581-768f-42ba-b66a-eae6887df7ce service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f17aea-76cd-49ac-b65b-c48500fd10f8 req-77556581-768f-42ba-b66a-eae6887df7ce service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d9f17aea-76cd-49ac-b65b-c48500fd10f8 req-77556581-768f-42ba-b66a-eae6887df7ce service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:04:42 user nova-compute[73067]: DEBUG nova.compute.manager [req-d9f17aea-76cd-49ac-b65b-c48500fd10f8 req-77556581-768f-42ba-b66a-eae6887df7ce service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:04:42 user nova-compute[73067]: WARNING nova.compute.manager [req-d9f17aea-76cd-49ac-b65b-c48500fd10f8 req-77556581-768f-42ba-b66a-eae6887df7ce service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state active and task_state None.
Aug 16 11:04:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:04:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:04:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:04:55 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:04:55 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:04:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:04:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:05:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-5cd32bdc-8ede-4d16-b240-4e9296204ad7 req-e6d1c444-511a-4c1a-b4f5-bac4fe2eda7a service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received event network-changed-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:05:00 user nova-compute[73067]: DEBUG nova.compute.manager [req-5cd32bdc-8ede-4d16-b240-4e9296204ad7 req-e6d1c444-511a-4c1a-b4f5-bac4fe2eda7a service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Refreshing instance network info cache due to event network-changed-82ec696e-0118-4141-a96f-e31db35877a3. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:05:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5cd32bdc-8ede-4d16-b240-4e9296204ad7 req-e6d1c444-511a-4c1a-b4f5-bac4fe2eda7a service nova] Acquiring lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:05:00 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5cd32bdc-8ede-4d16-b240-4e9296204ad7 req-e6d1c444-511a-4c1a-b4f5-bac4fe2eda7a service nova] Acquired lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:05:00 user nova-compute[73067]: DEBUG nova.network.neutron [req-5cd32bdc-8ede-4d16-b240-4e9296204ad7 req-e6d1c444-511a-4c1a-b4f5-bac4fe2eda7a service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Refreshing network info cache for port 82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG nova.network.neutron [req-5cd32bdc-8ede-4d16-b240-4e9296204ad7 req-e6d1c444-511a-4c1a-b4f5-bac4fe2eda7a service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updated VIF entry in instance network info cache for port 82ec696e-0118-4141-a96f-e31db35877a3. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG nova.network.neutron [req-5cd32bdc-8ede-4d16-b240-4e9296204ad7 req-e6d1c444-511a-4c1a-b4f5-bac4fe2eda7a service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updating instance_info_cache with network_info: [{"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5cd32bdc-8ede-4d16-b240-4e9296204ad7 req-e6d1c444-511a-4c1a-b4f5-bac4fe2eda7a service nova] Releasing lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:05:01 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updating instance_info_cache with network_info: [{"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-d57ddae8-029b-4f83-ae60-07c4c1d9279e" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:02 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:05:02 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:05:02 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8580MB free_disk=25.170406341552734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance d57ddae8-029b-4f83-ae60-07c4c1d9279e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:05:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance d9d82a13-233b-465b-ab55-93ec5e5d6a51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:05:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:05:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:05:03 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:05:03 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:05:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:05:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG nova.objects.instance [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:05 user nova-compute[73067]: INFO nova.compute.manager [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Attaching volume 0574c93f-bd63-46e9-9351-8185d31444b0 to /dev/vdb
Aug 16 11:05:05 user nova-compute[73067]: DEBUG os_brick.utils [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f084f4-79ab-4540-bc37-030923a17d7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[255f7c52-a67d-4246-a7aa-f56429319b9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[80313330-8ebd-4b27-9ffd-ba69dc43fbe0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25677ba-592a-45e8-9542-aa8d78c758a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:05:06 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:05:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:06 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:05:06 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:05:06 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cf47de-4fc3-4ede-a066-54c1eddbe395]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:06 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:05:06 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:05:06 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:05:06 user nova-compute[73067]: DEBUG os_brick.utils [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:05:06 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updating existing volume attachment record: 58f4f03e-f922-4eed-b7a1-2a41175612ab {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:05:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:09 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:05:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:05:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpMBreJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:05:15 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:05:15 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:05:15 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8606154c-bc8f-4bb1-b2d5-88ee6a487a63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:05:15 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ada3d4-e19e-4666-8613-2d79d6cd20a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0] added
Aug 16 11:05:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d8e508-ddbc-4a86-b18b-57edfc391bcf]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c3eacb-4cb5-4f17-9948-0da2ebd663cc]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FpMBreJU {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FpMBreJU" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2b5d27-5b43-4364-9ad3-7d2ef87f921d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FpMBreJU'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b18ca0-c2df-445f-b498-7e298c7226b3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d3d269-38c1-4825-b95b-ed92079c9d2c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:15 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:05:15 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8293b7-cbac-4e38-8131-83b79a2d0ec9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0, portal: 172.16.0.220,3260]
Aug 16 11:05:16 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0, portal: 172.16.0.220,3260] successful.
Aug 16 11:05:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9996c31-7d1a-4694-8d3a-3206c0a6553e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fe8e82-cf39-489d-bf25-2f05e8097dc0]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:16 user nova-compute[73067]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)
Aug 16 11:05:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:16 user nova-compute[73067]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)
Aug 16 11:05:16 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[938ebac2-e6fc-4427-b266-531172f391f8]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:05:16 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpMBreJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:05:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:05:17 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26439663139333432', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:05:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439663139333432', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:05:17 user nova-compute[73067]: DEBUG nova.objects.instance [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:05:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 11:05:17 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:05:17 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 11:05:17 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:05:17 user nova-compute[73067]:   <serial>0574c93f-bd63-46e9-9351-8185d31444b0</serial>
Aug 16 11:05:17 user nova-compute[73067]: </disk>
Aug 16 11:05:17 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 11:05:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:05:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:05:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No VIF found with MAC fa:16:3e:a8:85:70, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:05:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-34216f5e-dac4-45ee-884a-4fd21892edbe tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.849s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Verify base images {{(pid=73067) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73067) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Image id 8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58 yields fingerprint 7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 {{(pid=73067) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] image 8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58 at (/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832): checking
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] image 8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58 at (/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832): image is in use {{(pid=73067) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] d9d82a13-233b-465b-ab55-93ec5e5d6a51 is a valid instance name {{(pid=73067) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] d57ddae8-029b-4f83-ae60-07c4c1d9279e is a valid instance name {{(pid=73067) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] d57ddae8-029b-4f83-ae60-07c4c1d9279e has a disk file {{(pid=73067) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance d57ddae8-029b-4f83-ae60-07c4c1d9279e is backed by 7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 {{(pid=73067) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 11:05:22 user nova-compute[73067]: WARNING nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e
Aug 16 11:05:22 user nova-compute[73067]: WARNING nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Unknown base file: /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db
Aug 16 11:05:22 user nova-compute[73067]: WARNING nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048
Aug 16 11:05:22 user nova-compute[73067]: WARNING nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Unknown base file: /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b
Aug 16 11:05:22 user nova-compute[73067]: WARNING nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68
Aug 16 11:05:22 user nova-compute[73067]: WARNING nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Unknown base file: /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6
Aug 16 11:05:22 user nova-compute[73067]: WARNING nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58
Aug 16 11:05:22 user nova-compute[73067]: WARNING nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Unknown base file: /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7
Aug 16 11:05:22 user nova-compute[73067]: WARNING nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Unknown base file: /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Active base files: /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Removable base files: /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048 /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68 /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6 /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58 /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7 /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b6b06079bc3e0a1373dbae111adba5a3922a686e
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/be996f01d0363bbcc58b967b29afa7c9d729e7db
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2e2c0bc9b8f91b78080c354101aa3738cb275048
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/17cac0985e5636ec4f929f3577c4b91a1950a42b
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ddc0573da82372db8e8d9071f3fd0b16ea1f5b68
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/34a6674fef6ad6bd1533937324ea94bbfa56d8d6
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d9c5dc908e894c22594fcb0b8da45a8856fdbe58
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/423697174592b5a0a980509fe69c00eaba6176e7
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/375f32c80fefecd3d990db70630d005836f4fa35
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Verification complete {{(pid=73067) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Verify swap images {{(pid=73067) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.imagecache [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Verify ephemeral images {{(pid=73067) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:22 user nova-compute[73067]: INFO nova.compute.manager [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Attaching volume bcdc50ee-77dd-48b9-ab07-7d6da48d3947 to /dev/vdc
Aug 16 11:05:22 user nova-compute[73067]: DEBUG os_brick.utils [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5223315-f6a1-4ed3-a085-0143c96ff164]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88a9112-5c83-4179-b241-2b3be46b44d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9efc35-469f-499f-a6e0-803b533c6c8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6017de3c-73d3-477e-bebf-50e5724367fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:05:22 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:05:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fd3921-f443-49a6-ac90-12a235f63f50]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG os_brick.utils [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:05:22 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updating existing volume attachment record: 61b29824-071b-406d-82da-c8ca4888ff57 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:05:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:05:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHXAGKMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:05:32 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:05:32 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:05:32 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16cc793-eda0-4b72-98de-122ef090cd5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:05:32 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e8cb16-2f01-47e7-9a11-c200059bf7e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947] added
Aug 16 11:05:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57053ff-6056-478a-8828-e1862ae9c73d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9dd549-f698-47a0-82a9-26e7f17ed5b1]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHXAGKMU {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHXAGKMU" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdde8740-63ad-4ccb-8160-418a852620ee]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHXAGKMU'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d520de-635c-49d9-8d05-c9ebc20b2ef2]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cba7a8-1c89-40b8-b61b-d4b173a7e1e5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:32 user nova-compute[73067]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)
Aug 16 11:05:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:32 user nova-compute[73067]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)
Aug 16 11:05:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1282992b-478f-4bc6-a1e8-f4d45d43127d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947, portal: 172.16.0.220,3260]
Aug 16 11:05:32 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947, portal: 172.16.0.220,3260] successful.
Aug 16 11:05:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5fb37a-34f1-4339-a829-3d031f6be55b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[429958aa-b52f-4082-afc6-3c61ae24939e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:32 user nova-compute[73067]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)
Aug 16 11:05:32 user nova-compute[73067]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 (non-flash)
Aug 16 11:05:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:32 user nova-compute[73067]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)
Aug 16 11:05:32 user nova-compute[73067]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 (non-flash)
Aug 16 11:05:32 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a9445e-5c33-4d53-86ab-6e4010f67776]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:05:32 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHXAGKMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:05:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:05:33 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26631613564626265', 'path': '/dev/sdd'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:05:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631613564626265', 'path': '/dev/sdd'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:05:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:05:33 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 11:05:33 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:05:33 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 11:05:33 user nova-compute[73067]:   <target dev="vdc" bus="virtio"/>
Aug 16 11:05:33 user nova-compute[73067]:   <serial>bcdc50ee-77dd-48b9-ab07-7d6da48d3947</serial>
Aug 16 11:05:33 user nova-compute[73067]: </disk>
Aug 16 11:05:33 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 11:05:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:05:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:05:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:05:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] No VIF found with MAC fa:16:3e:a8:85:70, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:05:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3a4ef634-98af-40a9-a414-85245d30c0bb tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.821s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:35 user nova-compute[73067]: INFO nova.compute.manager [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Detaching volume 0574c93f-bd63-46e9-9351-8185d31444b0
Aug 16 11:05:35 user nova-compute[73067]: INFO nova.virt.block_device [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Attempting to driver detach volume 0574c93f-bd63-46e9-9351-8185d31444b0 from mountpoint /dev/vdb
Aug 16 11:05:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Attempting to detach device vdb from instance d57ddae8-029b-4f83-ae60-07c4c1d9279e from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 11:05:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:05:35 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:05:35 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 11:05:35 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:05:35 user nova-compute[73067]:   <serial>0574c93f-bd63-46e9-9351-8185d31444b0</serial>
Aug 16 11:05:35 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:05:35 user nova-compute[73067]: </disk>
Aug 16 11:05:35 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:05:35 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully detached device vdb from instance d57ddae8-029b-4f83-ae60-07c4c1d9279e from the persistent domain config.
Aug 16 11:05:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d57ddae8-029b-4f83-ae60-07c4c1d9279e from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 11:05:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:05:35 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:05:35 user nova-compute[73067]:   <source dev="/dev/sdc"/>
Aug 16 11:05:35 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:05:35 user nova-compute[73067]:   <serial>0574c93f-bd63-46e9-9351-8185d31444b0</serial>
Aug 16 11:05:35 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:05:35 user nova-compute[73067]: </disk>
Aug 16 11:05:35 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692183936.2986064, d57ddae8-029b-4f83-ae60-07c4c1d9279e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 11:05:36 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully detached device vdb from instance d57ddae8-029b-4f83-ae60-07c4c1d9279e from the live domain config.
Aug 16 11:05:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpMBreJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:05:36 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c233353-0996-4bb9-963f-0182433974b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc54121-6b6b-4fee-a88b-625845d91c39]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:36 user nova-compute[73067]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)
Aug 16 11:05:36 user nova-compute[73067]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 (non-flash)
Aug 16 11:05:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:36 user nova-compute[73067]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 (non-flash)
Aug 16 11:05:36 user nova-compute[73067]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 (non-flash)
Aug 16 11:05:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35914337f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd72ce-9d92-4485-8622-79272e2b0b2d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72123ee-1906-451f-a140-81dcb33e7818]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefc8435-3ceb-46db-a0fe-f423b99af970]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[280c7dff-b857-4a2c-8919-f7dffb787c22]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f05b6c7-fb71-461d-985e-77383839bf08]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c10255e-f647-421d-acf0-4e8219cb4c96]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0, portal: 172.16.0.220,3260]
Aug 16 11:05:36 user nova-compute[73067]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0, portal: 172.16.0.220,3260] successful.
Aug 16 11:05:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0574c93f-bd63-46e9-9351-8185d31444b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c796da-eb15-48e7-8074-64de25b7d01b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== disconnect_volume: return (271ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:05:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:05:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:37 user nova-compute[73067]: DEBUG nova.objects.instance [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:05:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-b624207f-03d7-483b-b089-dab2381508be tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.595s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:38 user nova-compute[73067]: INFO nova.compute.manager [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Detaching volume bcdc50ee-77dd-48b9-ab07-7d6da48d3947
Aug 16 11:05:38 user nova-compute[73067]: INFO nova.virt.block_device [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Attempting to driver detach volume bcdc50ee-77dd-48b9-ab07-7d6da48d3947 from mountpoint /dev/vdc
Aug 16 11:05:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Attempting to detach device vdc from instance d57ddae8-029b-4f83-ae60-07c4c1d9279e from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:05:38 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:05:38 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 11:05:38 user nova-compute[73067]:   <target dev="vdc" bus="virtio"/>
Aug 16 11:05:38 user nova-compute[73067]:   <serial>bcdc50ee-77dd-48b9-ab07-7d6da48d3947</serial>
Aug 16 11:05:38 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 11:05:38 user nova-compute[73067]: </disk>
Aug 16 11:05:38 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:05:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully detached device vdc from instance d57ddae8-029b-4f83-ae60-07c4c1d9279e from the persistent domain config.
Aug 16 11:05:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d57ddae8-029b-4f83-ae60-07c4c1d9279e from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:05:38 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:05:38 user nova-compute[73067]:   <source dev="/dev/sdd"/>
Aug 16 11:05:38 user nova-compute[73067]:   <target dev="vdc" bus="virtio"/>
Aug 16 11:05:38 user nova-compute[73067]:   <serial>bcdc50ee-77dd-48b9-ab07-7d6da48d3947</serial>
Aug 16 11:05:38 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 11:05:38 user nova-compute[73067]: </disk>
Aug 16 11:05:38 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692183938.727749, d57ddae8-029b-4f83-ae60-07c4c1d9279e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 11:05:38 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully detached device vdc from instance d57ddae8-029b-4f83-ae60-07c4c1d9279e from the live domain config.
Aug 16 11:05:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHXAGKMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:05:38 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[21888a8b-3c39-47fc-8e56-9d705243e93c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd30f87-19d9-41e8-bba5-da3ef8466c6f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:38 user nova-compute[73067]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 (non-flash)
Aug 16 11:05:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:05:38 user nova-compute[73067]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 (non-flash)
Aug 16 11:05:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35447ed090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947'): ({'sdd'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Removing single pathed devices sdd {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f00aa4-ceed-413a-a37b-156d52247212]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7650ccff-118d-434a-9918-c97684400128]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Flushing IO for device /dev/sdd {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d13e621-7059-42d9-9aaf-67bc6859751e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[885b31d4-68f7-491c-b3c5-6c715560fad6]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] SCSI volumes sdd have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adf9171-1cde-4ab5-b841-9fda820d16f8]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15b8b4d-1bd7-4161-9354-e65950e85eba]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947, portal: 172.16.0.220,3260]
Aug 16 11:05:38 user nova-compute[73067]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947, portal: 172.16.0.220,3260] successful.
Aug 16 11:05:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:05:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdc50ee-77dd-48b9-ab07-7d6da48d3947 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:05:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85ba0e8-5fcb-49ab-b8fa-543e5aa00511]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:05:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:05:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:05:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] <== disconnect_volume: return (263ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:05:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:05:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'flavor' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:05:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e2387fe8-1e0b-4414-8b71-103c1c11b87f tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.599s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:40 user nova-compute[73067]: INFO nova.compute.manager [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Terminating instance
Aug 16 11:05:40 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:05:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-015c2c49-f8ab-4418-a9c9-fafd1ad841fe req-883a97a9-d9fd-4055-a4b7-18d93e289e5f service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received event network-vif-unplugged-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-015c2c49-f8ab-4418-a9c9-fafd1ad841fe req-883a97a9-d9fd-4055-a4b7-18d93e289e5f service nova] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-015c2c49-f8ab-4418-a9c9-fafd1ad841fe req-883a97a9-d9fd-4055-a4b7-18d93e289e5f service nova] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-015c2c49-f8ab-4418-a9c9-fafd1ad841fe req-883a97a9-d9fd-4055-a4b7-18d93e289e5f service nova] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-015c2c49-f8ab-4418-a9c9-fafd1ad841fe req-883a97a9-d9fd-4055-a4b7-18d93e289e5f service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] No waiting events found dispatching network-vif-unplugged-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-015c2c49-f8ab-4418-a9c9-fafd1ad841fe req-883a97a9-d9fd-4055-a4b7-18d93e289e5f service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received event network-vif-unplugged-82ec696e-0118-4141-a96f-e31db35877a3 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Instance destroyed successfully.
Aug 16 11:05:41 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lazy-loading 'resources' on Instance uuid d57ddae8-029b-4f83-ae60-07c4c1d9279e {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1646069641',display_name='tempest-AttachVolumeTestJSON-server-1646069641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1646069641',id=43,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnbq/pJVnR5JLm+Q7tjIJ3wNIcHM4IxW5seU7J2Il8sECpmeGI+Bb8LC1xzMWUQ+NNeUUsJ/pJgHQAp9cg/hbZ8atQ6+lSBDa/V8TcOg3yKjVpYVvNW8IfwdTcV8n4jSw==',key_name='tempest-keypair-856414773',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bab7d6d47c14ddc9cfda43e4cf715e5',ramdisk_id='',reservation_id='r-lkjpsnk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1413526745',owner_user_name='tempest-AttachVolumeTestJSON-1413526745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b01dc15c8fa4a569b697670f32f203a',uuid=d57ddae8-029b-4f83-ae60-07c4c1d9279e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converting VIF {"id": "82ec696e-0118-4141-a96f-e31db35877a3", "address": "fa:16:3e:a8:85:70", "network": {"id": "e3d52447-43f5-4f64-95df-c261daa40359", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1712611044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bab7d6d47c14ddc9cfda43e4cf715e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ec696e-01", "ovs_interfaceid": "82ec696e-0118-4141-a96f-e31db35877a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:70,bridge_name='br-int',has_traffic_filtering=True,id=82ec696e-0118-4141-a96f-e31db35877a3,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ec696e-01') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG os_vif [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:70,bridge_name='br-int',has_traffic_filtering=True,id=82ec696e-0118-4141-a96f-e31db35877a3,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ec696e-01') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82ec696e-01, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:05:41 user nova-compute[73067]: INFO os_vif [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:70,bridge_name='br-int',has_traffic_filtering=True,id=82ec696e-0118-4141-a96f-e31db35877a3,network=Network(e3d52447-43f5-4f64-95df-c261daa40359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ec696e-01')
Aug 16 11:05:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Deleting instance files /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e_del
Aug 16 11:05:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Deletion of /opt/stack/data/nova/instances/d57ddae8-029b-4f83-ae60-07c4c1d9279e_del complete
Aug 16 11:05:41 user nova-compute[73067]: INFO nova.compute.manager [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 11:05:41 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:05:41 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:05:42 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:05:42 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Took 1.19 seconds to deallocate network for instance.
Aug 16 11:05:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:42 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:05:42 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:05:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:43 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Deleted allocations for instance d57ddae8-029b-4f83-ae60-07c4c1d9279e
Aug 16 11:05:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e0907717-8052-42c9-affc-fe43ef132322 tempest-AttachVolumeTestJSON-1413526745 tempest-AttachVolumeTestJSON-1413526745-project-member] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-04026920-3b77-4d95-baf2-3827c3f90cbd req-f04c825b-2638-4dab-b115-88c60c37c9ca service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received event network-vif-plugged-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:05:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-04026920-3b77-4d95-baf2-3827c3f90cbd req-f04c825b-2638-4dab-b115-88c60c37c9ca service nova] Acquiring lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:05:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-04026920-3b77-4d95-baf2-3827c3f90cbd req-f04c825b-2638-4dab-b115-88c60c37c9ca service nova] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:05:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-04026920-3b77-4d95-baf2-3827c3f90cbd req-f04c825b-2638-4dab-b115-88c60c37c9ca service nova] Lock "d57ddae8-029b-4f83-ae60-07c4c1d9279e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:05:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-04026920-3b77-4d95-baf2-3827c3f90cbd req-f04c825b-2638-4dab-b115-88c60c37c9ca service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] No waiting events found dispatching network-vif-plugged-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:05:43 user nova-compute[73067]: WARNING nova.compute.manager [req-04026920-3b77-4d95-baf2-3827c3f90cbd req-f04c825b-2638-4dab-b115-88c60c37c9ca service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received unexpected event network-vif-plugged-82ec696e-0118-4141-a96f-e31db35877a3 for instance with vm_state deleted and task_state None.
Aug 16 11:05:43 user nova-compute[73067]: DEBUG nova.compute.manager [req-04026920-3b77-4d95-baf2-3827c3f90cbd req-f04c825b-2638-4dab-b115-88c60c37c9ca service nova] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Received event network-vif-deleted-82ec696e-0118-4141-a96f-e31db35877a3 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:05:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:05:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:05:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:05:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:05:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:53 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:05:55 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:05:56 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:05:56 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183941.5187163, d57ddae8-029b-4f83-ae60-07c4c1d9279e => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:05:56 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] VM Stopped (Lifecycle Event)
Aug 16 11:05:56 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9be63393-5d83-448c-9cba-ee9f5c19e583 None None] [instance: d57ddae8-029b-4f83-ae60-07c4c1d9279e] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:05:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:05:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:05:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:01 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:06:01 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:06:01 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=25.1966552734375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance d9d82a13-233b-465b-ab55-93ec5e5d6a51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:01 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 11:06:03 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:03 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:06:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:06:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:06:03 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:06:04 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:06:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:06:04 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid d9d82a13-233b-465b-ab55-93ec5e5d6a51 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:06:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:11 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:06:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:06:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:06:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:06:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:06:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-ec7a400e-92f8-42a3-acec-04fda2f6632a req-cfe8f899-7b54-419d-a978-b0cf8fa5ff7b service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-changed-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-ec7a400e-92f8-42a3-acec-04fda2f6632a req-cfe8f899-7b54-419d-a978-b0cf8fa5ff7b service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Refreshing instance network info cache due to event network-changed-946cf489-0604-4bb0-a75c-1f4341fd7c8e. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ec7a400e-92f8-42a3-acec-04fda2f6632a req-cfe8f899-7b54-419d-a978-b0cf8fa5ff7b service nova] Acquiring lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ec7a400e-92f8-42a3-acec-04fda2f6632a req-cfe8f899-7b54-419d-a978-b0cf8fa5ff7b service nova] Acquired lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG nova.network.neutron [req-ec7a400e-92f8-42a3-acec-04fda2f6632a req-cfe8f899-7b54-419d-a978-b0cf8fa5ff7b service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Refreshing network info cache for port 946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:19 user nova-compute[73067]: INFO nova.compute.manager [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Shelve offloading
Aug 16 11:06:19 user nova-compute[73067]: DEBUG nova.network.neutron [req-ec7a400e-92f8-42a3-acec-04fda2f6632a req-cfe8f899-7b54-419d-a978-b0cf8fa5ff7b service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updated VIF entry in instance network info cache for port 946cf489-0604-4bb0-a75c-1f4341fd7c8e. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG nova.network.neutron [req-ec7a400e-92f8-42a3-acec-04fda2f6632a req-cfe8f899-7b54-419d-a978-b0cf8fa5ff7b service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ec7a400e-92f8-42a3-acec-04fda2f6632a req-cfe8f899-7b54-419d-a978-b0cf8fa5ff7b service nova] Releasing lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-c8a2c14d-d2a4-4a22-8daa-4c894e0d0ec4 req-93308cf6-35dd-45cf-a31f-476762537aba service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:06:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c8a2c14d-d2a4-4a22-8daa-4c894e0d0ec4 req-93308cf6-35dd-45cf-a31f-476762537aba service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c8a2c14d-d2a4-4a22-8daa-4c894e0d0ec4 req-93308cf6-35dd-45cf-a31f-476762537aba service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-c8a2c14d-d2a4-4a22-8daa-4c894e0d0ec4 req-93308cf6-35dd-45cf-a31f-476762537aba service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-c8a2c14d-d2a4-4a22-8daa-4c894e0d0ec4 req-93308cf6-35dd-45cf-a31f-476762537aba service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:06:20 user nova-compute[73067]: WARNING nova.compute.manager [req-c8a2c14d-d2a4-4a22-8daa-4c894e0d0ec4 req-93308cf6-35dd-45cf-a31f-476762537aba service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state active and task_state shelving.
Aug 16 11:06:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:20 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Instance destroyed successfully.
Aug 16 11:06:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:06:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:06:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquired lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:06:20 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:06:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:21 user nova-compute[73067]: DEBUG nova.network.neutron [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:06:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Releasing lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:06:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Instance destroyed successfully.
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lazy-loading 'resources' on Instance uuid d9d82a13-233b-465b-ab55-93ec5e5d6a51 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-822056961',display_name='tempest-TestShelveInstance-server-822056961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-822056961',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuiv0Z3DCYprJ26jun6hgC5OZXZZiklQpEAjHM4zJ6Gsu2mWJkvfcSfb1tEdYYMB8kka5B3e9I6LQ6e/jsLEj22jhRMwy+ppLNlcpVYGHcDAh6pZ+JqJ4Z+Bs6qgYguLA==',key_name='tempest-TestShelveInstance-696161861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:04:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6706c7063ed47a093bf6a015d62e1ab',ramdisk_id='',reservation_id='r-0yfrf7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1150615292',owner_user_name='tempest-TestShelveInstance-1150615292-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:04:42Z,user_data=None,user_id='fccdae9c933a48a2a2750119c0a9cf33',uuid=d9d82a13-233b-465b-ab55-93ec5e5d6a51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converting VIF {"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_vif [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap946cf489-06, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:06:22 user nova-compute[73067]: INFO os_vif [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06')
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmOGwYSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:06:22 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2738098e-d799-4271-8948-a35dd325c0ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc58cb-3f7e-4428-b7f7-de13a328e06c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:06:22 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:06:22 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3564119000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:06:22 user nova-compute[73067]: WARNING nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state active and task_state shelving.
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:06:22 user nova-compute[73067]: WARNING nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state active and task_state shelving.
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:06:22 user nova-compute[73067]: WARNING nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state active and task_state shelving.
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:06:22 user nova-compute[73067]: WARNING nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state active and task_state shelving.
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:06:22 user nova-compute[73067]: WARNING nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state active and task_state shelving.
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:06:22 user nova-compute[73067]: WARNING nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state active and task_state shelving.
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-changed-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Refreshing instance network info cache due to event network-changed-946cf489-0604-4bb0-a75c-1f4341fd7c8e. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Acquiring lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Acquired lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Refreshing network info cache for port 946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab20857f-a860-4a17-aea3-fa1945e32d8f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44fea4e-02f3-4438-a8c8-1cb1dfec8711]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f507ca-9190-4ae9-92ed-bcaa0b563c9f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d6e452-786a-4fd6-b2d7-1787c1188978]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7339d35b-0688-4e6d-86f9-14889e595e3a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e457d1-21ce-43cd-96c0-f1b8d43f78b0]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260]
Aug 16 11:06:22 user nova-compute[73067]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260] successful.
Aug 16 11:06:22 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d9a30-4b8a-495d-845c-f3f2ad7701ad]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] <== disconnect_volume: return (281ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:06:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Deleting instance files /opt/stack/data/nova/instances/d9d82a13-233b-465b-ab55-93ec5e5d6a51_del
Aug 16 11:06:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Deletion of /opt/stack/data/nova/instances/d9d82a13-233b-465b-ab55-93ec5e5d6a51_del complete
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updated VIF entry in instance network info cache for port 946cf489-0604-4bb0-a75c-1f4341fd7c8e. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": null, "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap946cf489-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:06:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28e87f23-cf1c-4eab-b08b-ee5767f6f476 req-bbfb974f-7c7e-42fa-bdab-fd5810478219 service nova] Releasing lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:06:23 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Deleted allocations for instance d9d82a13-233b-465b-ab55-93ec5e5d6a51
Aug 16 11:06:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:06:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:06:23 user nova-compute[73067]: DEBUG nova.objects.instance [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lazy-loading 'numa_topology' on Instance uuid d9d82a13-233b-465b-ab55-93ec5e5d6a51 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:06:23 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:06:23 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:06:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.092s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-ded38b07-cb3e-4c64-997c-f8e851d4ccd6 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.870s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:06:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 11:06:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 11:06:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:35 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692183980.472204, d9d82a13-233b-465b-ab55-93ec5e5d6a51 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:06:35 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] VM Stopped (Lifecycle Event)
Aug 16 11:06:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ca9c9718-f7ff-4fc7-8113-690543391c01 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:06:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:06:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:55 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:06:57 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:06:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:07:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:07:02 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:07:02 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=25.18707275390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:07:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:07:03 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:07:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:07:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:07:03 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:07:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:07:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:08 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:07:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:12 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:07:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:07:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:07:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:07:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Acquiring lock "c258e3c7-60d0-4c09-a3ad-66906598b860" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:07:43 user nova-compute[73067]: INFO nova.compute.claims [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Claim successful on node user
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.176s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:07:43 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.policy [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '079be0a9a5b54c06a4078303fe0e2dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd246a7475f78489591fee427b06caf35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:07:43 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Creating image(s)
Aug 16 11:07:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Acquiring lock "/opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "/opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "/opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:07:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk 1073741824" returned: 0 in 0.048s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.220s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Cannot resize image /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG nova.objects.instance [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lazy-loading 'migration_context' on Instance uuid c258e3c7-60d0-4c09-a3ad-66906598b860 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Ensure instance console log exists: /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:07:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Successfully created port: 9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Successfully updated port: 9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Acquiring lock "refresh_cache-c258e3c7-60d0-4c09-a3ad-66906598b860" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Acquired lock "refresh_cache-c258e3c7-60d0-4c09-a3ad-66906598b860" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-b0404b96-a5fd-488e-a404-da0110772ac8 req-2e1a69e7-3537-48df-9fe4-19566503a88d service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Received event network-changed-9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-b0404b96-a5fd-488e-a404-da0110772ac8 req-2e1a69e7-3537-48df-9fe4-19566503a88d service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Refreshing instance network info cache due to event network-changed-9f501403-fa70-4449-b821-7e25321c1d1b. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b0404b96-a5fd-488e-a404-da0110772ac8 req-2e1a69e7-3537-48df-9fe4-19566503a88d service nova] Acquiring lock "refresh_cache-c258e3c7-60d0-4c09-a3ad-66906598b860" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Updating instance_info_cache with network_info: [{"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Releasing lock "refresh_cache-c258e3c7-60d0-4c09-a3ad-66906598b860" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Instance network_info: |[{"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b0404b96-a5fd-488e-a404-da0110772ac8 req-2e1a69e7-3537-48df-9fe4-19566503a88d service nova] Acquired lock "refresh_cache-c258e3c7-60d0-4c09-a3ad-66906598b860" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.network.neutron [req-b0404b96-a5fd-488e-a404-da0110772ac8 req-2e1a69e7-3537-48df-9fe4-19566503a88d service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Refreshing network info cache for port 9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Start _get_guest_xml network_info=[{"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:07:45 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:07:45 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:07:45 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1494107256',display_name='tempest-VolumesActionsTest-instance-1494107256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1494107256',id=45,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d246a7475f78489591fee427b06caf35',ramdisk_id='',reservation_id='r-7jel1h39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-791581444',owner_user_name='tempest-VolumesActionsTest-791581444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:07:44Z,user_data=None,user_id='079be0a9a5b54c06a4078303fe0e2dcf',uuid=c258e3c7-60d0-4c09-a3ad-66906598b860,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Converting VIF {"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:79,bridge_name='br-int',has_traffic_filtering=True,id=9f501403-fa70-4449-b821-7e25321c1d1b,network=Network(37ca6650-db41-4b57-8ce8-71b6bd3ea77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f501403-fa') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.objects.instance [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lazy-loading 'pci_devices' on Instance uuid c258e3c7-60d0-4c09-a3ad-66906598b860 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:07:46 user nova-compute[73067]:   <uuid>c258e3c7-60d0-4c09-a3ad-66906598b860</uuid>
Aug 16 11:07:46 user nova-compute[73067]:   <name>instance-0000002d</name>
Aug 16 11:07:46 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:07:46 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:07:46 user nova-compute[73067]:   <metadata>
Aug 16 11:07:46 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:07:46 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:07:46 user nova-compute[73067]:       <nova:name>tempest-VolumesActionsTest-instance-1494107256</nova:name>
Aug 16 11:07:46 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:07:45</nova:creationTime>
Aug 16 11:07:46 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:07:46 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:07:46 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:07:46 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:07:46 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:07:46 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:07:46 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:07:46 user nova-compute[73067]:       <nova:owner>
Aug 16 11:07:46 user nova-compute[73067]:         <nova:user uuid="079be0a9a5b54c06a4078303fe0e2dcf">tempest-VolumesActionsTest-791581444-project-member</nova:user>
Aug 16 11:07:46 user nova-compute[73067]:         <nova:project uuid="d246a7475f78489591fee427b06caf35">tempest-VolumesActionsTest-791581444</nova:project>
Aug 16 11:07:46 user nova-compute[73067]:       </nova:owner>
Aug 16 11:07:46 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 11:07:46 user nova-compute[73067]:       <nova:ports>
Aug 16 11:07:46 user nova-compute[73067]:         <nova:port uuid="9f501403-fa70-4449-b821-7e25321c1d1b">
Aug 16 11:07:46 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 11:07:46 user nova-compute[73067]:         </nova:port>
Aug 16 11:07:46 user nova-compute[73067]:       </nova:ports>
Aug 16 11:07:46 user nova-compute[73067]:     </nova:instance>
Aug 16 11:07:46 user nova-compute[73067]:   </metadata>
Aug 16 11:07:46 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:07:46 user nova-compute[73067]:     <system>
Aug 16 11:07:46 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:07:46 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:07:46 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:07:46 user nova-compute[73067]:       <entry name="serial">c258e3c7-60d0-4c09-a3ad-66906598b860</entry>
Aug 16 11:07:46 user nova-compute[73067]:       <entry name="uuid">c258e3c7-60d0-4c09-a3ad-66906598b860</entry>
Aug 16 11:07:46 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:07:46 user nova-compute[73067]:     </system>
Aug 16 11:07:46 user nova-compute[73067]:   </sysinfo>
Aug 16 11:07:46 user nova-compute[73067]:   <os>
Aug 16 11:07:46 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:07:46 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:07:46 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:07:46 user nova-compute[73067]:   </os>
Aug 16 11:07:46 user nova-compute[73067]:   <features>
Aug 16 11:07:46 user nova-compute[73067]:     <acpi/>
Aug 16 11:07:46 user nova-compute[73067]:     <apic/>
Aug 16 11:07:46 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:07:46 user nova-compute[73067]:   </features>
Aug 16 11:07:46 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:07:46 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:07:46 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:07:46 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:07:46 user nova-compute[73067]:   </clock>
Aug 16 11:07:46 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:07:46 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:07:46 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:07:46 user nova-compute[73067]:   </cpu>
Aug 16 11:07:46 user nova-compute[73067]:   <devices>
Aug 16 11:07:46 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 11:07:46 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 11:07:46 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk"/>
Aug 16 11:07:46 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:07:46 user nova-compute[73067]:     </disk>
Aug 16 11:07:46 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:07:46 user nova-compute[73067]:       <mac address="fa:16:3e:c9:4f:79"/>
Aug 16 11:07:46 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:07:46 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:07:46 user nova-compute[73067]:       <target dev="tap9f501403-fa"/>
Aug 16 11:07:46 user nova-compute[73067]:     </interface>
Aug 16 11:07:46 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:07:46 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/console.log" append="off"/>
Aug 16 11:07:46 user nova-compute[73067]:     </serial>
Aug 16 11:07:46 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:07:46 user nova-compute[73067]:     <video>
Aug 16 11:07:46 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:07:46 user nova-compute[73067]:     </video>
Aug 16 11:07:46 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:07:46 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:07:46 user nova-compute[73067]:     </rng>
Aug 16 11:07:46 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:07:46 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:07:46 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:07:46 user nova-compute[73067]:     </memballoon>
Aug 16 11:07:46 user nova-compute[73067]:   </devices>
Aug 16 11:07:46 user nova-compute[73067]: </domain>
Aug 16 11:07:46 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1494107256',display_name='tempest-VolumesActionsTest-instance-1494107256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1494107256',id=45,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d246a7475f78489591fee427b06caf35',ramdisk_id='',reservation_id='r-7jel1h39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-791581444',owner_user_name='tempest-VolumesActionsTest-791581444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:07:44Z,user_data=None,user_id='079be0a9a5b54c06a4078303fe0e2dcf',uuid=c258e3c7-60d0-4c09-a3ad-66906598b860,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Converting VIF {"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:79,bridge_name='br-int',has_traffic_filtering=True,id=9f501403-fa70-4449-b821-7e25321c1d1b,network=Network(37ca6650-db41-4b57-8ce8-71b6bd3ea77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f501403-fa') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG os_vif [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:79,bridge_name='br-int',has_traffic_filtering=True,id=9f501403-fa70-4449-b821-7e25321c1d1b,network=Network(37ca6650-db41-4b57-8ce8-71b6bd3ea77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f501403-fa') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f501403-fa, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f501403-fa, col_values=(('external_ids', {'iface-id': '9f501403-fa70-4449-b821-7e25321c1d1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:4f:79', 'vm-uuid': 'c258e3c7-60d0-4c09-a3ad-66906598b860'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:46 user nova-compute[73067]: INFO os_vif [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:79,bridge_name='br-int',has_traffic_filtering=True,id=9f501403-fa70-4449-b821-7e25321c1d1b,network=Network(37ca6650-db41-4b57-8ce8-71b6bd3ea77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f501403-fa')
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] No VIF found with MAC fa:16:3e:c9:4f:79, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.network.neutron [req-b0404b96-a5fd-488e-a404-da0110772ac8 req-2e1a69e7-3537-48df-9fe4-19566503a88d service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Updated VIF entry in instance network info cache for port 9f501403-fa70-4449-b821-7e25321c1d1b. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG nova.network.neutron [req-b0404b96-a5fd-488e-a404-da0110772ac8 req-2e1a69e7-3537-48df-9fe4-19566503a88d service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Updating instance_info_cache with network_info: [{"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:07:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b0404b96-a5fd-488e-a404-da0110772ac8 req-2e1a69e7-3537-48df-9fe4-19566503a88d service nova] Releasing lock "refresh_cache-c258e3c7-60d0-4c09-a3ad-66906598b860" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-babbb0f3-9278-4fee-93a3-827f772913ee req-539125af-4d0b-415a-be0f-e9a190d93c7f service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Received event network-vif-plugged-9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-babbb0f3-9278-4fee-93a3-827f772913ee req-539125af-4d0b-415a-be0f-e9a190d93c7f service nova] Acquiring lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-babbb0f3-9278-4fee-93a3-827f772913ee req-539125af-4d0b-415a-be0f-e9a190d93c7f service nova] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-babbb0f3-9278-4fee-93a3-827f772913ee req-539125af-4d0b-415a-be0f-e9a190d93c7f service nova] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-babbb0f3-9278-4fee-93a3-827f772913ee req-539125af-4d0b-415a-be0f-e9a190d93c7f service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] No waiting events found dispatching network-vif-plugged-9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:07:47 user nova-compute[73067]: WARNING nova.compute.manager [req-babbb0f3-9278-4fee-93a3-827f772913ee req-539125af-4d0b-415a-be0f-e9a190d93c7f service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Received unexpected event network-vif-plugged-9f501403-fa70-4449-b821-7e25321c1d1b for instance with vm_state building and task_state spawning.
Aug 16 11:07:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184069.487916, c258e3c7-60d0-4c09-a3ad-66906598b860 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:07:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] VM Resumed (Lifecycle Event)
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:07:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Instance spawned successfully.
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:07:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184069.4922724, c258e3c7-60d0-4c09-a3ad-66906598b860 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:07:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] VM Started (Lifecycle Event)
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:07:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:07:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:07:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Took 6.29 seconds to build instance.
Aug 16 11:07:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8eee77e6-76d6-413d-946e-6f0bdecc4b3a tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.423s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-d6832340-6254-4017-9b2a-66161a99ffe5 req-d9d9379e-0d11-49da-9dea-6a36b8be577c service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Received event network-vif-plugged-9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d6832340-6254-4017-9b2a-66161a99ffe5 req-d9d9379e-0d11-49da-9dea-6a36b8be577c service nova] Acquiring lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d6832340-6254-4017-9b2a-66161a99ffe5 req-d9d9379e-0d11-49da-9dea-6a36b8be577c service nova] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d6832340-6254-4017-9b2a-66161a99ffe5 req-d9d9379e-0d11-49da-9dea-6a36b8be577c service nova] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:07:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-d6832340-6254-4017-9b2a-66161a99ffe5 req-d9d9379e-0d11-49da-9dea-6a36b8be577c service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] No waiting events found dispatching network-vif-plugged-9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:07:49 user nova-compute[73067]: WARNING nova.compute.manager [req-d6832340-6254-4017-9b2a-66161a99ffe5 req-d9d9379e-0d11-49da-9dea-6a36b8be577c service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Received unexpected event network-vif-plugged-9f501403-fa70-4449-b821-7e25321c1d1b for instance with vm_state active and task_state None.
Aug 16 11:07:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:57 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:07:57 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:07:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:07:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:02 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:08:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:08:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:08:02 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:08:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:02 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:03 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:08:03 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:08:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=25.18402862548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:08:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:08:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:08:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance c258e3c7-60d0-4c09-a3ad-66906598b860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:08:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:08:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:08:03 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:08:03 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:08:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:08:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-c258e3c7-60d0-4c09-a3ad-66906598b860" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-c258e3c7-60d0-4c09-a3ad-66906598b860" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid c258e3c7-60d0-4c09-a3ad-66906598b860 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Updating instance_info_cache with network_info: [{"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-c258e3c7-60d0-4c09-a3ad-66906598b860" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:08:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:08:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:08:07 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:10 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:08:11 user nova-compute[73067]: INFO nova.compute.manager [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Unshelving
Aug 16 11:08:11 user nova-compute[73067]: INFO nova.virt.block_device [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Booting with volume 795d47c6-2830-4a6d-812d-27fd0127aaa4 at /dev/vda
Aug 16 11:08:11 user nova-compute[73067]: DEBUG os_brick.utils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fbb78a-f73d-4de4-b4e5-b62d9d111d37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4add1ddd-6c2c-465d-843a-792177899e62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb1ff47-7610-464c-9c0a-c92ba2ed914c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d749960-21d2-4fb3-a31a-cba067aaaa29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:08:11 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:08:11 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9cab5b-8bf7-42e8-8377-a1384e3f3ca0]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG os_brick.utils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:08:11 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating existing volume attachment record: 0fcc97ab-eca4-4172-b5bb-bbfaceac89e6 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:08:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:08:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:08:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:08:21 user nova-compute[73067]: DEBUG nova.objects.instance [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lazy-loading 'pci_requests' on Instance uuid d9d82a13-233b-465b-ab55-93ec5e5d6a51 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:08:21 user nova-compute[73067]: DEBUG nova.objects.instance [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lazy-loading 'numa_topology' on Instance uuid d9d82a13-233b-465b-ab55-93ec5e5d6a51 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:08:21 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:08:21 user nova-compute[73067]: INFO nova.compute.claims [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Claim successful on node user
Aug 16 11:08:21 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:08:21 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:08:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:08:21 user nova-compute[73067]: INFO nova.network.neutron [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating port 946cf489-0604-4bb0-a75c-1f4341fd7c8e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 11:08:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquired lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.network.neutron [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-2dcaa7fb-883a-4719-9e87-dee4e2a3f543 req-dc1bd925-3b41-4351-b1fd-be0727f129ee service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-changed-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-2dcaa7fb-883a-4719-9e87-dee4e2a3f543 req-dc1bd925-3b41-4351-b1fd-be0727f129ee service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Refreshing instance network info cache due to event network-changed-946cf489-0604-4bb0-a75c-1f4341fd7c8e. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2dcaa7fb-883a-4719-9e87-dee4e2a3f543 req-dc1bd925-3b41-4351-b1fd-be0727f129ee service nova] Acquiring lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.network.neutron [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Releasing lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:08:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Creating image(s)
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Ensure instance console log exists: /opt/stack/data/nova/instances/d9d82a13-233b-465b-ab55-93ec5e5d6a51/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Start _get_guest_xml network_info=[{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmOGwYSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd9d82a13-233b-465b-ab55-93ec5e5d6a51', 'attached_at': '', 'detached_at': '', 'volume_id': '795d47c6-2830-4a6d-812d-27fd0127aaa4', 'serial': '795d47c6-2830-4a6d-812d-27fd0127aaa4'}, 'delete_on_termination': True, 'attachment_id': '0fcc97ab-eca4-4172-b5bb-bbfaceac89e6', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2dcaa7fb-883a-4719-9e87-dee4e2a3f543 req-dc1bd925-3b41-4351-b1fd-be0727f129ee service nova] Acquired lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-2dcaa7fb-883a-4719-9e87-dee4e2a3f543 req-dc1bd925-3b41-4351-b1fd-be0727f129ee service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Refreshing network info cache for port 946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:08:22 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:08:22 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.objects.instance [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lazy-loading 'vcpu_model' on Instance uuid d9d82a13-233b-465b-ab55-93ec5e5d6a51 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmOGwYSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:08:22 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:08:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:08:22 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:08:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:08:22 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8dabdc-8e82-4713-8b2d-c752140af0a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:08:22 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9780de77-e2d4-4455-842b-38ee5883758b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4] added
Aug 16 11:08:22 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:08:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a20a057-6dfb-42d8-816a-7c61f0ebe8f4]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61e8f7e-4bdf-4962-a67c-5d7f3282c56e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmOGwYSy {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmOGwYSy" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44f8498-a752-4ba3-ac7c-ea4c9935562d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmOGwYSy'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d43ff-935f-47fe-a46d-0e06ba7d665b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f57e6f-07b9-4d5a-9dbc-8a2d6d70718d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:08:23 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:08:23 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:08:23 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 11:08:23 user nova-compute[73067]: 
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aec3ab2-4676-4ba2-a241-1ba7551b397b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260]
Aug 16 11:08:23 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260] successful.
Aug 16 11:08:23 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[750cbfd6-e956-4d80-be8b-0fa947121137]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5bbead-ec5c-4fae-98b6-8efad21e400f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:08:23 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:08:23 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a862d97-a579-4c72-9d6d-a99f3ca33a32]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmOGwYSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG nova.network.neutron [req-2dcaa7fb-883a-4719-9e87-dee4e2a3f543 req-dc1bd925-3b41-4351-b1fd-be0727f129ee service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updated VIF entry in instance network info cache for port 946cf489-0604-4bb0-a75c-1f4341fd7c8e. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG nova.network.neutron [req-2dcaa7fb-883a-4719-9e87-dee4e2a3f543 req-dc1bd925-3b41-4351-b1fd-be0727f129ee service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:08:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2dcaa7fb-883a-4719-9e87-dee4e2a3f543 req-dc1bd925-3b41-4351-b1fd-be0727f129ee service nova] Releasing lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26438633435323763', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438633435323763', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T11:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-822056961',display_name='tempest-TestShelveInstance-server-822056961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-822056961',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-696161861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:04:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c6706c7063ed47a093bf6a015d62e1ab',ramdisk_id='',reservation_id='r-0yfrf7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1150615292',owner_user_name='tempest-TestShelveInstance-1150615292-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:08:11Z,user_data=None,user_id='fccdae9c933a48a2a2750119c0a9cf33',uuid=d9d82a13-233b-465b-ab55-93ec5e5d6a51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converting VIF {"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.objects.instance [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lazy-loading 'pci_devices' on Instance uuid d9d82a13-233b-465b-ab55-93ec5e5d6a51 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:08:24 user nova-compute[73067]:   <uuid>d9d82a13-233b-465b-ab55-93ec5e5d6a51</uuid>
Aug 16 11:08:24 user nova-compute[73067]:   <name>instance-0000002c</name>
Aug 16 11:08:24 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:08:24 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:08:24 user nova-compute[73067]:   <metadata>
Aug 16 11:08:24 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:08:24 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:08:24 user nova-compute[73067]:       <nova:name>tempest-TestShelveInstance-server-822056961</nova:name>
Aug 16 11:08:24 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:08:22</nova:creationTime>
Aug 16 11:08:24 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:08:24 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:08:24 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:08:24 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:08:24 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:08:24 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:08:24 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:08:24 user nova-compute[73067]:       <nova:owner>
Aug 16 11:08:24 user nova-compute[73067]:         <nova:user uuid="fccdae9c933a48a2a2750119c0a9cf33">tempest-TestShelveInstance-1150615292-project-member</nova:user>
Aug 16 11:08:24 user nova-compute[73067]:         <nova:project uuid="c6706c7063ed47a093bf6a015d62e1ab">tempest-TestShelveInstance-1150615292</nova:project>
Aug 16 11:08:24 user nova-compute[73067]:       </nova:owner>
Aug 16 11:08:24 user nova-compute[73067]:       <nova:ports>
Aug 16 11:08:24 user nova-compute[73067]:         <nova:port uuid="946cf489-0604-4bb0-a75c-1f4341fd7c8e">
Aug 16 11:08:24 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 11:08:24 user nova-compute[73067]:         </nova:port>
Aug 16 11:08:24 user nova-compute[73067]:       </nova:ports>
Aug 16 11:08:24 user nova-compute[73067]:     </nova:instance>
Aug 16 11:08:24 user nova-compute[73067]:   </metadata>
Aug 16 11:08:24 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:08:24 user nova-compute[73067]:     <system>
Aug 16 11:08:24 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:08:24 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:08:24 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:08:24 user nova-compute[73067]:       <entry name="serial">d9d82a13-233b-465b-ab55-93ec5e5d6a51</entry>
Aug 16 11:08:24 user nova-compute[73067]:       <entry name="uuid">d9d82a13-233b-465b-ab55-93ec5e5d6a51</entry>
Aug 16 11:08:24 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:08:24 user nova-compute[73067]:     </system>
Aug 16 11:08:24 user nova-compute[73067]:   </sysinfo>
Aug 16 11:08:24 user nova-compute[73067]:   <os>
Aug 16 11:08:24 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:08:24 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:08:24 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:08:24 user nova-compute[73067]:   </os>
Aug 16 11:08:24 user nova-compute[73067]:   <features>
Aug 16 11:08:24 user nova-compute[73067]:     <acpi/>
Aug 16 11:08:24 user nova-compute[73067]:     <apic/>
Aug 16 11:08:24 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:08:24 user nova-compute[73067]:   </features>
Aug 16 11:08:24 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:08:24 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:08:24 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:08:24 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:08:24 user nova-compute[73067]:   </clock>
Aug 16 11:08:24 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:08:24 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:08:24 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:08:24 user nova-compute[73067]:   </cpu>
Aug 16 11:08:24 user nova-compute[73067]:   <devices>
Aug 16 11:08:24 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 11:08:24 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:08:24 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 11:08:24 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:08:24 user nova-compute[73067]:       <serial>795d47c6-2830-4a6d-812d-27fd0127aaa4</serial>
Aug 16 11:08:24 user nova-compute[73067]:     </disk>
Aug 16 11:08:24 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:08:24 user nova-compute[73067]:       <mac address="fa:16:3e:4e:61:5f"/>
Aug 16 11:08:24 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:08:24 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:08:24 user nova-compute[73067]:       <target dev="tap946cf489-06"/>
Aug 16 11:08:24 user nova-compute[73067]:     </interface>
Aug 16 11:08:24 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:08:24 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/d9d82a13-233b-465b-ab55-93ec5e5d6a51/console.log" append="off"/>
Aug 16 11:08:24 user nova-compute[73067]:     </serial>
Aug 16 11:08:24 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:08:24 user nova-compute[73067]:     <video>
Aug 16 11:08:24 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:08:24 user nova-compute[73067]:     </video>
Aug 16 11:08:24 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:08:24 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:08:24 user nova-compute[73067]:     </rng>
Aug 16 11:08:24 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:08:24 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:08:24 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:08:24 user nova-compute[73067]:     </memballoon>
Aug 16 11:08:24 user nova-compute[73067]:   </devices>
Aug 16 11:08:24 user nova-compute[73067]: </domain>
Aug 16 11:08:24 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T11:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-822056961',display_name='tempest-TestShelveInstance-server-822056961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-822056961',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-696161861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:04:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c6706c7063ed47a093bf6a015d62e1ab',ramdisk_id='',reservation_id='r-0yfrf7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1150615292',owner_user_name='tempest-TestShelveInstance-1150615292-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:08:11Z,user_data=None,user_id='fccdae9c933a48a2a2750119c0a9cf33',uuid=d9d82a13-233b-465b-ab55-93ec5e5d6a51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converting VIF {"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG os_vif [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap946cf489-06, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap946cf489-06, col_values=(('external_ids', {'iface-id': '946cf489-0604-4bb0-a75c-1f4341fd7c8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:61:5f', 'vm-uuid': 'd9d82a13-233b-465b-ab55-93ec5e5d6a51'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:24 user nova-compute[73067]: INFO os_vif [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06')
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:08:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] No VIF found with MAC fa:16:3e:4e:61:5f, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:08:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-0da39148-3c8e-4568-b532-ad9f4ce4a689 req-256e38d2-d224-4a47-bb6c-1d9866cb7782 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:08:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0da39148-3c8e-4568-b532-ad9f4ce4a689 req-256e38d2-d224-4a47-bb6c-1d9866cb7782 service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:08:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0da39148-3c8e-4568-b532-ad9f4ce4a689 req-256e38d2-d224-4a47-bb6c-1d9866cb7782 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:08:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0da39148-3c8e-4568-b532-ad9f4ce4a689 req-256e38d2-d224-4a47-bb6c-1d9866cb7782 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:08:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-0da39148-3c8e-4568-b532-ad9f4ce4a689 req-256e38d2-d224-4a47-bb6c-1d9866cb7782 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:08:25 user nova-compute[73067]: WARNING nova.compute.manager [req-0da39148-3c8e-4568-b532-ad9f4ce4a689 req-256e38d2-d224-4a47-bb6c-1d9866cb7782 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 11:08:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184107.5883584, d9d82a13-233b-465b-ab55-93ec5e5d6a51 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:08:27 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] VM Resumed (Lifecycle Event)
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:08:27 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Instance spawned successfully.
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:08:27 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184107.588702, d9d82a13-233b-465b-ab55-93ec5e5d6a51 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:08:27 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] VM Started (Lifecycle Event)
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-756da7fa-7217-45f1-886c-099c141c26ae tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.437s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-30662982-cd0e-42e9-a3e0-cad89150c86c req-b750a0e3-f0d1-4ad5-9ae3-78201103ca83 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-30662982-cd0e-42e9-a3e0-cad89150c86c req-b750a0e3-f0d1-4ad5-9ae3-78201103ca83 service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-30662982-cd0e-42e9-a3e0-cad89150c86c req-b750a0e3-f0d1-4ad5-9ae3-78201103ca83 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-30662982-cd0e-42e9-a3e0-cad89150c86c req-b750a0e3-f0d1-4ad5-9ae3-78201103ca83 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:08:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-30662982-cd0e-42e9-a3e0-cad89150c86c req-b750a0e3-f0d1-4ad5-9ae3-78201103ca83 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:08:27 user nova-compute[73067]: WARNING nova.compute.manager [req-30662982-cd0e-42e9-a3e0-cad89150c86c req-b750a0e3-f0d1-4ad5-9ae3-78201103ca83 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state active and task_state None.
Aug 16 11:08:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:49 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:54 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:08:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:58 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:08:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:02 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:09:03 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:09:03 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:09:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=25.154632568359375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:09:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:09:04 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance c258e3c7-60d0-4c09-a3ad-66906598b860 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:09:04 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance d9d82a13-233b-465b-ab55-93ec5e5d6a51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:09:04 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:09:04 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:09:04 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:09:04 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:09:04 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:09:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:09:04 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:09:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:09:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:09:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:09:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:09:06 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:09:06 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid d9d82a13-233b-465b-ab55-93ec5e5d6a51 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:09:06 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:09:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:09:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:09:09 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:09:09 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:09:12 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:09:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:09:16 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:09:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:09:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4972-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:09:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:09:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:09:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:09:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:09:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:29 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:09:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:09:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:09:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:09:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:09:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:09:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Acquiring lock "c258e3c7-60d0-4c09-a3ad-66906598b860" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:09:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:09:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Acquiring lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:09:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:09:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:09:44 user nova-compute[73067]: INFO nova.compute.manager [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Terminating instance
Aug 16 11:09:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:09:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:44 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:45 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Instance destroyed successfully.
Aug 16 11:09:45 user nova-compute[73067]: DEBUG nova.objects.instance [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lazy-loading 'resources' on Instance uuid c258e3c7-60d0-4c09-a3ad-66906598b860 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1494107256',display_name='tempest-VolumesActionsTest-instance-1494107256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1494107256',id=45,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:07:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d246a7475f78489591fee427b06caf35',ramdisk_id='',reservation_id='r-7jel1h39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-791581444',owner_user_name='tempest-VolumesActionsTest-791581444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:07:50Z,user_data=None,user_id='079be0a9a5b54c06a4078303fe0e2dcf',uuid=c258e3c7-60d0-4c09-a3ad-66906598b860,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Converting VIF {"id": "9f501403-fa70-4449-b821-7e25321c1d1b", "address": "fa:16:3e:c9:4f:79", "network": {"id": "37ca6650-db41-4b57-8ce8-71b6bd3ea77b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741156553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d246a7475f78489591fee427b06caf35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f501403-fa", "ovs_interfaceid": "9f501403-fa70-4449-b821-7e25321c1d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:4f:79,bridge_name='br-int',has_traffic_filtering=True,id=9f501403-fa70-4449-b821-7e25321c1d1b,network=Network(37ca6650-db41-4b57-8ce8-71b6bd3ea77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f501403-fa') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG os_vif [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:4f:79,bridge_name='br-int',has_traffic_filtering=True,id=9f501403-fa70-4449-b821-7e25321c1d1b,network=Network(37ca6650-db41-4b57-8ce8-71b6bd3ea77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f501403-fa') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f501403-fa, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:09:45 user nova-compute[73067]: INFO os_vif [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:4f:79,bridge_name='br-int',has_traffic_filtering=True,id=9f501403-fa70-4449-b821-7e25321c1d1b,network=Network(37ca6650-db41-4b57-8ce8-71b6bd3ea77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f501403-fa')
Aug 16 11:09:45 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Deleting instance files /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860_del
Aug 16 11:09:45 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Deletion of /opt/stack/data/nova/instances/c258e3c7-60d0-4c09-a3ad-66906598b860_del complete
Aug 16 11:09:45 user nova-compute[73067]: INFO nova.compute.manager [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 11:09:45 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-0ec7e0b7-0fe0-43f3-aaf1-cb4298f3de85 req-98b35bc6-764a-4d20-9751-28e151f851a1 service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Received event network-vif-unplugged-9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0ec7e0b7-0fe0-43f3-aaf1-cb4298f3de85 req-98b35bc6-764a-4d20-9751-28e151f851a1 service nova] Acquiring lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0ec7e0b7-0fe0-43f3-aaf1-cb4298f3de85 req-98b35bc6-764a-4d20-9751-28e151f851a1 service nova] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-0ec7e0b7-0fe0-43f3-aaf1-cb4298f3de85 req-98b35bc6-764a-4d20-9751-28e151f851a1 service nova] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-0ec7e0b7-0fe0-43f3-aaf1-cb4298f3de85 req-98b35bc6-764a-4d20-9751-28e151f851a1 service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] No waiting events found dispatching network-vif-unplugged-9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG nova.compute.manager [req-0ec7e0b7-0fe0-43f3-aaf1-cb4298f3de85 req-98b35bc6-764a-4d20-9751-28e151f851a1 service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Received event network-vif-unplugged-9f501403-fa70-4449-b821-7e25321c1d1b for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:45 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:09:45 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Took 0.73 seconds to deallocate network for instance.
Aug 16 11:09:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:09:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:09:46 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:09:46 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:09:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:09:46 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Deleted allocations for instance c258e3c7-60d0-4c09-a3ad-66906598b860
Aug 16 11:09:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-733ba3c6-dad3-4132-a0a0-dee111e51ca2 tempest-VolumesActionsTest-791581444 tempest-VolumesActionsTest-791581444-project-member] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.959s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:09:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-ea5c5f88-0567-4af3-98a6-6a66ee0c1e70 req-a37d8a93-53e8-44a8-9969-992369a0a10f service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Received event network-vif-plugged-9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:09:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea5c5f88-0567-4af3-98a6-6a66ee0c1e70 req-a37d8a93-53e8-44a8-9969-992369a0a10f service nova] Acquiring lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:09:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea5c5f88-0567-4af3-98a6-6a66ee0c1e70 req-a37d8a93-53e8-44a8-9969-992369a0a10f service nova] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:09:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ea5c5f88-0567-4af3-98a6-6a66ee0c1e70 req-a37d8a93-53e8-44a8-9969-992369a0a10f service nova] Lock "c258e3c7-60d0-4c09-a3ad-66906598b860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:09:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-ea5c5f88-0567-4af3-98a6-6a66ee0c1e70 req-a37d8a93-53e8-44a8-9969-992369a0a10f service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] No waiting events found dispatching network-vif-plugged-9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:09:47 user nova-compute[73067]: WARNING nova.compute.manager [req-ea5c5f88-0567-4af3-98a6-6a66ee0c1e70 req-a37d8a93-53e8-44a8-9969-992369a0a10f service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Received unexpected event network-vif-plugged-9f501403-fa70-4449-b821-7e25321c1d1b for instance with vm_state deleted and task_state None.
Aug 16 11:09:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-ea5c5f88-0567-4af3-98a6-6a66ee0c1e70 req-a37d8a93-53e8-44a8-9969-992369a0a10f service nova] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Received event network-vif-deleted-9f501403-fa70-4449-b821-7e25321c1d1b {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:09:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:09:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:09:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:09:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:09:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:09:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:00 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:10:00 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:10:00 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692184185.1219532, c258e3c7-60d0-4c09-a3ad-66906598b860 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:10:00 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] VM Stopped (Lifecycle Event)
Aug 16 11:10:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-aa7b39e2-1a69-472a-8480-8486ae93ce17 None None] [instance: c258e3c7-60d0-4c09-a3ad-66906598b860] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:10:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-f9bd76da-4602-48b5-a250-0fbf8c27432d req-ade9ddc9-3dd2-4ed2-9e8d-b20221c684fb service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-changed-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG nova.compute.manager [req-f9bd76da-4602-48b5-a250-0fbf8c27432d req-ade9ddc9-3dd2-4ed2-9e8d-b20221c684fb service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Refreshing instance network info cache due to event network-changed-946cf489-0604-4bb0-a75c-1f4341fd7c8e. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f9bd76da-4602-48b5-a250-0fbf8c27432d req-ade9ddc9-3dd2-4ed2-9e8d-b20221c684fb service nova] Acquiring lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f9bd76da-4602-48b5-a250-0fbf8c27432d req-ade9ddc9-3dd2-4ed2-9e8d-b20221c684fb service nova] Acquired lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG nova.network.neutron [req-f9bd76da-4602-48b5-a250-0fbf8c27432d req-ade9ddc9-3dd2-4ed2-9e8d-b20221c684fb service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Refreshing network info cache for port 946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:10:02 user nova-compute[73067]: INFO nova.compute.manager [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Terminating instance
Aug 16 11:10:02 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:10:03 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Instance destroyed successfully.
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.objects.instance [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lazy-loading 'resources' on Instance uuid d9d82a13-233b-465b-ab55-93ec5e5d6a51 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T11:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-822056961',display_name='tempest-TestShelveInstance-server-822056961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-822056961',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuiv0Z3DCYprJ26jun6hgC5OZXZZiklQpEAjHM4zJ6Gsu2mWJkvfcSfb1tEdYYMB8kka5B3e9I6LQ6e/jsLEj22jhRMwy+ppLNlcpVYGHcDAh6pZ+JqJ4Z+Bs6qgYguLA==',key_name='tempest-TestShelveInstance-696161861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:08:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6706c7063ed47a093bf6a015d62e1ab',ramdisk_id='',reservation_id='r-0yfrf7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1150615292',owner_user_name='tempest-TestShelveInstance-1150615292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:08:28Z,user_data=None,user_id='fccdae9c933a48a2a2750119c0a9cf33',uuid=d9d82a13-233b-465b-ab55-93ec5e5d6a51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converting VIF {"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_vif [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap946cf489-06, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:10:03 user nova-compute[73067]: INFO os_vif [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=946cf489-0604-4bb0-a75c-1f4341fd7c8e,network=Network(3386bbf0-0e00-4418-891e-56bfba8ade27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946cf489-06')
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmOGwYSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:10:03 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d1d213-428a-4a0c-af9f-6132eed4152a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7f31a8-22a7-49b7-90a1-a226c6ba4343]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:10:03 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 (non-flash)
Aug 16 11:10:03 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3584294dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd446e7-42a1-4251-b84e-bba7d54d779e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.network.neutron [req-f9bd76da-4602-48b5-a250-0fbf8c27432d req-ade9ddc9-3dd2-4ed2-9e8d-b20221c684fb service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updated VIF entry in instance network info cache for port 946cf489-0604-4bb0-a75c-1f4341fd7c8e. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.network.neutron [req-f9bd76da-4602-48b5-a250-0fbf8c27432d req-ade9ddc9-3dd2-4ed2-9e8d-b20221c684fb service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [{"id": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "address": "fa:16:3e:4e:61:5f", "network": {"id": "3386bbf0-0e00-4418-891e-56bfba8ade27", "bridge": "br-int", "label": "tempest-TestShelveInstance-628659743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6706c7063ed47a093bf6a015d62e1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946cf489-06", "ovs_interfaceid": "946cf489-0604-4bb0-a75c-1f4341fd7c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6dddef-bbcf-422c-86f1-3f92ed116168]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:10:03 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:10:03 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=25.173686981201172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f9bd76da-4602-48b5-a250-0fbf8c27432d req-ade9ddc9-3dd2-4ed2-9e8d-b20221c684fb service nova] Releasing lock "refresh_cache-d9d82a13-233b-465b-ab55-93ec5e5d6a51" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead727d9-31ab-4d65-b3c8-444f332b9eb3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[112599e5-c499-44bd-941e-8bd00a2b6ee0]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance d9d82a13-233b-465b-ab55-93ec5e5d6a51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[be582c98-9c1a-4e5f-81cf-b2e2ca3c27ad]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[19852066-9fcc-43c3-a372-520242c7b0ba]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260]
Aug 16 11:10:03 user nova-compute[73067]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4, portal: 172.16.0.220,3260] successful.
Aug 16 11:10:03 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:795d47c6-2830-4a6d-812d-27fd0127aaa4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ffc0af-25a7-4833-8327-30840d7e3fec]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.633s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] <== disconnect_volume: return (634ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:10:03 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Deleting instance files /opt/stack/data/nova/instances/d9d82a13-233b-465b-ab55-93ec5e5d6a51_del
Aug 16 11:10:03 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Deletion of /opt/stack/data/nova/instances/d9d82a13-233b-465b-ab55-93ec5e5d6a51_del complete
Aug 16 11:10:03 user nova-compute[73067]: INFO nova.compute.manager [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 16 11:10:03 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:10:03 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:10:04 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Took 0.45 seconds to deallocate network for instance.
Aug 16 11:10:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-unplugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] Acquiring lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:10:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] No waiting events found dispatching network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:10:04 user nova-compute[73067]: WARNING nova.compute.manager [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received unexpected event network-vif-plugged-946cf489-0604-4bb0-a75c-1f4341fd7c8e for instance with vm_state active and task_state deleting.
Aug 16 11:10:04 user nova-compute[73067]: DEBUG nova.compute.manager [req-b2affae8-78b5-4eef-93e6-299f010fbdd2 req-4d5ed763-dc66-45e9-b7df-d30ccf702867 service nova] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Received event network-vif-deleted-946cf489-0604-4bb0-a75c-1f4341fd7c8e {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:10:05 user nova-compute[73067]: INFO nova.compute.manager [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 11:10:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Deleting volume: 795d47c6-2830-4a6d-812d-27fd0127aaa4 {{(pid=73067) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 11:10:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:10:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:10:05 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:10:05 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:10:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:10:05 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Deleted allocations for instance d9d82a13-233b-465b-ab55-93ec5e5d6a51
Aug 16 11:10:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-0ab12209-4188-43ca-ba17-e716faf55af7 tempest-TestShelveInstance-1150615292 tempest-TestShelveInstance-1150615292-project-member] Lock "d9d82a13-233b-465b-ab55-93ec5e5d6a51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.249s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:10:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:10:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:10:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:10:06 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:10:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:11 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:10:13 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:10:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:10:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:10:17 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:10:18 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692184203.177186, d9d82a13-233b-465b-ab55-93ec5e5d6a51 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:10:18 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] VM Stopped (Lifecycle Event)
Aug 16 11:10:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ec9277f9-e00d-4767-9a56-dc83eef9cfa6 None None] [instance: d9d82a13-233b-465b-ab55-93ec5e5d6a51] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:10:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:10:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:10:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:10:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:10:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:10:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:10:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:10:59 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:02 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:04 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:11:05 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:11:05 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:11:05 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=25.171722412109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:08 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:11:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:11:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:11:08 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:08 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 11:11:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:11 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:13 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:14 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:11:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:30 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:11:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 11:11:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 11:11:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:11:34 user nova-compute[73067]: INFO nova.compute.claims [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Claim successful on node user
Aug 16 11:11:34 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:11:34 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:11:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:11:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:11:34 user nova-compute[73067]: INFO nova.virt.block_device [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Booting with volume snapshot 937f56a1-a1dd-45f3-9e5b-413b9da0364c at /dev/vda
Aug 16 11:11:34 user nova-compute[73067]: DEBUG nova.policy [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bda8cdb53a94455a9a666ad43d60434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a30d2208752496280dd6347a3fcd87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:11:35 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Successfully created port: 44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:11:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Successfully updated port: 44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:11:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:11:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquired lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:11:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:11:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:11:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-28b75e66-8a0b-4782-8779-89e10763ddc4 req-5c9f0736-92c6-45d7-9e29-c7fbc5693cf6 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Received event network-changed-44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:11:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-28b75e66-8a0b-4782-8779-89e10763ddc4 req-5c9f0736-92c6-45d7-9e29-c7fbc5693cf6 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Refreshing instance network info cache due to event network-changed-44084712-c9a2-44ef-9b57-9d0b58a0565a. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:11:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28b75e66-8a0b-4782-8779-89e10763ddc4 req-5c9f0736-92c6-45d7-9e29-c7fbc5693cf6 service nova] Acquiring lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:11:37 user nova-compute[73067]: DEBUG nova.network.neutron [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Updating instance_info_cache with network_info: [{"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:11:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Releasing lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:11:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Instance network_info: |[{"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:11:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28b75e66-8a0b-4782-8779-89e10763ddc4 req-5c9f0736-92c6-45d7-9e29-c7fbc5693cf6 service nova] Acquired lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:11:37 user nova-compute[73067]: DEBUG nova.network.neutron [req-28b75e66-8a0b-4782-8779-89e10763ddc4 req-5c9f0736-92c6-45d7-9e29-c7fbc5693cf6 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Refreshing network info cache for port 44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:11:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:37 user nova-compute[73067]: DEBUG nova.network.neutron [req-28b75e66-8a0b-4782-8779-89e10763ddc4 req-5c9f0736-92c6-45d7-9e29-c7fbc5693cf6 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Updated VIF entry in instance network info cache for port 44084712-c9a2-44ef-9b57-9d0b58a0565a. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:11:37 user nova-compute[73067]: DEBUG nova.network.neutron [req-28b75e66-8a0b-4782-8779-89e10763ddc4 req-5c9f0736-92c6-45d7-9e29-c7fbc5693cf6 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Updating instance_info_cache with network_info: [{"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:11:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28b75e66-8a0b-4782-8779-89e10763ddc4 req-5c9f0736-92c6-45d7-9e29-c7fbc5693cf6 service nova] Releasing lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:11:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG os_brick.utils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f283bb58-02cc-4465-98f1-5cf7bd07b1a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cccd15-f4a9-4ebf-9272-ad71786242b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bac37b-2cb0-4c94-99b4-6854676a4b74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c02c99-ddf0-4822-a055-0c3ca32e1845]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:11:40 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:11:40 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cec505-039c-4c09-971c-e58efe06ba90]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG os_brick.utils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:11:40 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Updating existing volume attachment record: 0dd8b940-d05d-4c9d-9cc3-61137ebd54bc {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:11:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:11:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:11:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Creating image(s)
Aug 16 11:11:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 11:11:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Ensure instance console log exists: /opt/stack/data/nova/instances/0f829733-ad3e-4dc4-b38d-3ccbdc727e6a/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:11:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:11:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:11:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Start _get_guest_xml network_info=[{"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAwomQlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f829733-ad3e-4dc4-b38d-3ccbdc727e6a', 'attached_at': '', 'detached_at': '', 'volume_id': 'fce110d0-6efd-4bfa-b61d-4888ddfd3f28', 'serial': 'fce110d0-6efd-4bfa-b61d-4888ddfd3f28'}, 'delete_on_termination': True, 'attachment_id': '0dd8b940-d05d-4c9d-9cc3-61137ebd54bc', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:11:50 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:11:50 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAwomQlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:11:50 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:11:50 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:11:50 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dfa88e-ca25-402a-8b0c-fb2cbba73b92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:11:50 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0641efef-2c36-400a-9e3e-a784f1c611f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28] added
Aug 16 11:11:50 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b893f7-94cf-4c95-be23-2025de7b57f2]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[623b9e21-d990-453f-b777-8f9f85d3efdd]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZAwomQlF {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZAwomQlF" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[511135bc-65d6-44f8-b923-5dd4651b1094]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZAwomQlF'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c56aab-ec88-4ac0-a8f6-ccbe8671c005]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fb62da-c3f2-47df-95a0-d985770275fb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:11:50 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:11:50 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:11:50 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 11:11:50 user nova-compute[73067]: 
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a9bac3-d133-4771-82b0-b8c43384e13a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28, portal: 172.16.0.220,3260]
Aug 16 11:11:50 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28, portal: 172.16.0.220,3260] successful.
Aug 16 11:11:50 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaf814e-4660-4736-a8e5-feb6b6cbd807]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[22034c39-bef4-47a0-892f-ba54762d90ab]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 (non-flash)
Aug 16 11:11:50 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 (non-flash)
Aug 16 11:11:50 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7d4be5-2f6f-44df-8b86-0a5d2971f2c4]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:11:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAwomQlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23637663033363465', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637663033363465', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:11:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-376728449',display_name='tempest-TestVolumeBootPattern-server-376728449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-376728449',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-hd4y6kse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:11:35Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=0f829733-ad3e-4dc4-b38d-3ccbdc727e6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:81,bridge_name='br-int',has_traffic_filtering=True,id=44084712-c9a2-44ef-9b57-9d0b58a0565a,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44084712-c9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:11:51 user nova-compute[73067]:   <uuid>0f829733-ad3e-4dc4-b38d-3ccbdc727e6a</uuid>
Aug 16 11:11:51 user nova-compute[73067]:   <name>instance-0000002e</name>
Aug 16 11:11:51 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:11:51 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:11:51 user nova-compute[73067]:   <metadata>
Aug 16 11:11:51 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:11:51 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:11:51 user nova-compute[73067]:       <nova:name>tempest-TestVolumeBootPattern-server-376728449</nova:name>
Aug 16 11:11:51 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:11:50</nova:creationTime>
Aug 16 11:11:51 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:11:51 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:11:51 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:11:51 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:11:51 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:11:51 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:11:51 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:11:51 user nova-compute[73067]:       <nova:owner>
Aug 16 11:11:51 user nova-compute[73067]:         <nova:user uuid="0bda8cdb53a94455a9a666ad43d60434">tempest-TestVolumeBootPattern-1996305180-project-member</nova:user>
Aug 16 11:11:51 user nova-compute[73067]:         <nova:project uuid="1a30d2208752496280dd6347a3fcd87d">tempest-TestVolumeBootPattern-1996305180</nova:project>
Aug 16 11:11:51 user nova-compute[73067]:       </nova:owner>
Aug 16 11:11:51 user nova-compute[73067]:       <nova:ports>
Aug 16 11:11:51 user nova-compute[73067]:         <nova:port uuid="44084712-c9a2-44ef-9b57-9d0b58a0565a">
Aug 16 11:11:51 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 11:11:51 user nova-compute[73067]:         </nova:port>
Aug 16 11:11:51 user nova-compute[73067]:       </nova:ports>
Aug 16 11:11:51 user nova-compute[73067]:     </nova:instance>
Aug 16 11:11:51 user nova-compute[73067]:   </metadata>
Aug 16 11:11:51 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:11:51 user nova-compute[73067]:     <system>
Aug 16 11:11:51 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:11:51 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:11:51 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:11:51 user nova-compute[73067]:       <entry name="serial">0f829733-ad3e-4dc4-b38d-3ccbdc727e6a</entry>
Aug 16 11:11:51 user nova-compute[73067]:       <entry name="uuid">0f829733-ad3e-4dc4-b38d-3ccbdc727e6a</entry>
Aug 16 11:11:51 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:11:51 user nova-compute[73067]:     </system>
Aug 16 11:11:51 user nova-compute[73067]:   </sysinfo>
Aug 16 11:11:51 user nova-compute[73067]:   <os>
Aug 16 11:11:51 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:11:51 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:11:51 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:11:51 user nova-compute[73067]:   </os>
Aug 16 11:11:51 user nova-compute[73067]:   <features>
Aug 16 11:11:51 user nova-compute[73067]:     <acpi/>
Aug 16 11:11:51 user nova-compute[73067]:     <apic/>
Aug 16 11:11:51 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:11:51 user nova-compute[73067]:   </features>
Aug 16 11:11:51 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:11:51 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:11:51 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:11:51 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:11:51 user nova-compute[73067]:   </clock>
Aug 16 11:11:51 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:11:51 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:11:51 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:11:51 user nova-compute[73067]:   </cpu>
Aug 16 11:11:51 user nova-compute[73067]:   <devices>
Aug 16 11:11:51 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 11:11:51 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:11:51 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 11:11:51 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:11:51 user nova-compute[73067]:       <serial>fce110d0-6efd-4bfa-b61d-4888ddfd3f28</serial>
Aug 16 11:11:51 user nova-compute[73067]:     </disk>
Aug 16 11:11:51 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:11:51 user nova-compute[73067]:       <mac address="fa:16:3e:3b:ea:81"/>
Aug 16 11:11:51 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:11:51 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:11:51 user nova-compute[73067]:       <target dev="tap44084712-c9"/>
Aug 16 11:11:51 user nova-compute[73067]:     </interface>
Aug 16 11:11:51 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:11:51 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/0f829733-ad3e-4dc4-b38d-3ccbdc727e6a/console.log" append="off"/>
Aug 16 11:11:51 user nova-compute[73067]:     </serial>
Aug 16 11:11:51 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:11:51 user nova-compute[73067]:     <video>
Aug 16 11:11:51 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:11:51 user nova-compute[73067]:     </video>
Aug 16 11:11:51 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:11:51 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:11:51 user nova-compute[73067]:     </rng>
Aug 16 11:11:51 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:11:51 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:11:51 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:11:51 user nova-compute[73067]:     </memballoon>
Aug 16 11:11:51 user nova-compute[73067]:   </devices>
Aug 16 11:11:51 user nova-compute[73067]: </domain>
Aug 16 11:11:51 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:11:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-376728449',display_name='tempest-TestVolumeBootPattern-server-376728449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-376728449',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-hd4y6kse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:11:35Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=0f829733-ad3e-4dc4-b38d-3ccbdc727e6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:81,bridge_name='br-int',has_traffic_filtering=True,id=44084712-c9a2-44ef-9b57-9d0b58a0565a,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44084712-c9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG os_vif [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:81,bridge_name='br-int',has_traffic_filtering=True,id=44084712-c9a2-44ef-9b57-9d0b58a0565a,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44084712-c9') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44084712-c9, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44084712-c9, col_values=(('external_ids', {'iface-id': '44084712-c9a2-44ef-9b57-9d0b58a0565a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:ea:81', 'vm-uuid': '0f829733-ad3e-4dc4-b38d-3ccbdc727e6a'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:51 user nova-compute[73067]: INFO os_vif [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:81,bridge_name='br-int',has_traffic_filtering=True,id=44084712-c9a2-44ef-9b57-9d0b58a0565a,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44084712-c9')
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:11:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No VIF found with MAC fa:16:3e:3b:ea:81, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:11:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:53 user nova-compute[73067]: DEBUG nova.compute.manager [req-510520e1-3fa4-4e7e-bba3-7ceaeda404c0 req-2c7d2f01-27fb-4c19-b487-7316b302e8c1 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Received event network-vif-plugged-44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:11:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-510520e1-3fa4-4e7e-bba3-7ceaeda404c0 req-2c7d2f01-27fb-4c19-b487-7316b302e8c1 service nova] Acquiring lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:11:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-510520e1-3fa4-4e7e-bba3-7ceaeda404c0 req-2c7d2f01-27fb-4c19-b487-7316b302e8c1 service nova] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:11:53 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-510520e1-3fa4-4e7e-bba3-7ceaeda404c0 req-2c7d2f01-27fb-4c19-b487-7316b302e8c1 service nova] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:11:53 user nova-compute[73067]: DEBUG nova.compute.manager [req-510520e1-3fa4-4e7e-bba3-7ceaeda404c0 req-2c7d2f01-27fb-4c19-b487-7316b302e8c1 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] No waiting events found dispatching network-vif-plugged-44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:11:53 user nova-compute[73067]: WARNING nova.compute.manager [req-510520e1-3fa4-4e7e-bba3-7ceaeda404c0 req-2c7d2f01-27fb-4c19-b487-7316b302e8c1 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Received unexpected event network-vif-plugged-44084712-c9a2-44ef-9b57-9d0b58a0565a for instance with vm_state building and task_state spawning.
Aug 16 11:11:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184314.8093753, 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:11:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] VM Resumed (Lifecycle Event)
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:11:54 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Instance spawned successfully.
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:11:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184314.810792, 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:11:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] VM Started (Lifecycle Event)
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:11:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:11:54 user nova-compute[73067]: INFO nova.compute.manager [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Took 4.96 seconds to spawn the instance on the hypervisor.
Aug 16 11:11:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:11:55 user nova-compute[73067]: INFO nova.compute.manager [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Took 20.95 seconds to build instance.
Aug 16 11:11:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d7713de4-02a9-4f68-8e87-41d056d71e5a tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.056s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:11:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-d82236bf-33ad-483d-a494-7a2a8f4b6d19 req-eb1c79e0-01f4-49d4-83ff-9bded2688eab service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Received event network-vif-plugged-44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:11:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d82236bf-33ad-483d-a494-7a2a8f4b6d19 req-eb1c79e0-01f4-49d4-83ff-9bded2688eab service nova] Acquiring lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:11:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d82236bf-33ad-483d-a494-7a2a8f4b6d19 req-eb1c79e0-01f4-49d4-83ff-9bded2688eab service nova] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:11:55 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d82236bf-33ad-483d-a494-7a2a8f4b6d19 req-eb1c79e0-01f4-49d4-83ff-9bded2688eab service nova] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:11:55 user nova-compute[73067]: DEBUG nova.compute.manager [req-d82236bf-33ad-483d-a494-7a2a8f4b6d19 req-eb1c79e0-01f4-49d4-83ff-9bded2688eab service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] No waiting events found dispatching network-vif-plugged-44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:11:55 user nova-compute[73067]: WARNING nova.compute.manager [req-d82236bf-33ad-483d-a494-7a2a8f4b6d19 req-eb1c79e0-01f4-49d4-83ff-9bded2688eab service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Received unexpected event network-vif-plugged-44084712-c9a2-44ef-9b57-9d0b58a0565a for instance with vm_state active and task_state None.
Aug 16 11:11:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:11:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:01 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:12:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:02 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:12:04 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:06 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:12:06 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:12:06 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.16830062866211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 11:12:06 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 11:12:07 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 11:12:07 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 11:12:07 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:12:07 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:12:07 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:12:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:12:09 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:12:10 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:12:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:12:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:12:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:12:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:12:10 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:12:10 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:12:11 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Updating instance_info_cache with network_info: [{"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:12:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:12:11 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:12:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:12:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:12:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:12:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:12:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:13 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:12:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:12:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:19 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:12:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:12:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:12:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:12:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:12:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:12:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:12:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:12:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:12:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:12:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:13:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:13:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:13:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:13:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:03 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:13:04 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:13:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:13:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:13:07 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:13:07 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:13:07 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=25.16765594482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:13:07 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:13:08 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:13:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:13:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:13:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:13:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:13:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:13:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:12 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:13:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:13:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:13:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:13:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:13:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:13:12 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:13:12 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Updating instance_info_cache with network_info: [{"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:13:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:13:12 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:13:13 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:13:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:13:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:13:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:13:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:13:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:13:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:13:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:13:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:13:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:13:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:13:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:13:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:13:24 user nova-compute[73067]: INFO nova.compute.manager [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Terminating instance
Aug 16 11:13:24 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:13:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:24 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-28a4074f-95e1-4b20-9e77-4ba5d67ed18c req-cff542e7-1860-484b-a833-c9bd44132a12 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Received event network-vif-unplugged-44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28a4074f-95e1-4b20-9e77-4ba5d67ed18c req-cff542e7-1860-484b-a833-c9bd44132a12 service nova] Acquiring lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28a4074f-95e1-4b20-9e77-4ba5d67ed18c req-cff542e7-1860-484b-a833-c9bd44132a12 service nova] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-28a4074f-95e1-4b20-9e77-4ba5d67ed18c req-cff542e7-1860-484b-a833-c9bd44132a12 service nova] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-28a4074f-95e1-4b20-9e77-4ba5d67ed18c req-cff542e7-1860-484b-a833-c9bd44132a12 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] No waiting events found dispatching network-vif-unplugged-44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-28a4074f-95e1-4b20-9e77-4ba5d67ed18c req-cff542e7-1860-484b-a833-c9bd44132a12 service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Received event network-vif-unplugged-44084712-c9a2-44ef-9b57-9d0b58a0565a for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:25 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Instance destroyed successfully.
Aug 16 11:13:25 user nova-compute[73067]: DEBUG nova.objects.instance [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'resources' on Instance uuid 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:11:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-376728449',display_name='tempest-TestVolumeBootPattern-server-376728449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-376728449',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:11:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-hd4y6kse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:11:55Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=0f829733-ad3e-4dc4-b38d-3ccbdc727e6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "address": "fa:16:3e:3b:ea:81", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44084712-c9", "ovs_interfaceid": "44084712-c9a2-44ef-9b57-9d0b58a0565a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ea:81,bridge_name='br-int',has_traffic_filtering=True,id=44084712-c9a2-44ef-9b57-9d0b58a0565a,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44084712-c9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_vif [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ea:81,bridge_name='br-int',has_traffic_filtering=True,id=44084712-c9a2-44ef-9b57-9d0b58a0565a,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44084712-c9') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44084712-c9, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:13:25 user nova-compute[73067]: INFO os_vif [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ea:81,bridge_name='br-int',has_traffic_filtering=True,id=44084712-c9a2-44ef-9b57-9d0b58a0565a,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44084712-c9')
Aug 16 11:13:25 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAwomQlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:13:25 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce899a08-e15e-4680-8503-d023cd4a2720]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3d096c-88ac-4a59-954c-7b71b380b8d7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 (non-flash)
Aug 16 11:13:25 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 (non-flash)
Aug 16 11:13:25 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35841cd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e922f7-2a9c-426c-9463-d7f89e81e9f9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8f3f04-c40c-4c1c-9cbd-f207701473da]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[412e6ce5-9dc9-40ec-b221-2a3c4d7f7f09]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:13:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[853c728c-4029-4f2c-8959-2a2a3c53ed75]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9a16e394', '/dev/disk/by-id/scsi-1SCST_BIO9a16e394-67f0364ec6a58dbd', '/dev/disk/by-id/scsi-23637663033363465') {{(pid=84181) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ff51cb-fdc7-4045-bdf7-cf02fdaf8b5a]: (4, None) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4ae0f6-002e-4510-9a33-972707ae8f35]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aee855-5444-42d5-aab6-7420c06a00b9]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28, portal: 172.16.0.220,3260]
Aug 16 11:13:26 user nova-compute[73067]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28, portal: 172.16.0.220,3260] successful.
Aug 16 11:13:26 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce110d0-6efd-4bfa-b61d-4888ddfd3f28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1eaf47-bed3-4f0f-8a8e-cf7b9daaf389]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== disconnect_volume: return (292ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:13:26 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Deleting instance files /opt/stack/data/nova/instances/0f829733-ad3e-4dc4-b38d-3ccbdc727e6a_del
Aug 16 11:13:26 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Deletion of /opt/stack/data/nova/instances/0f829733-ad3e-4dc4-b38d-3ccbdc727e6a_del complete
Aug 16 11:13:26 user nova-compute[73067]: INFO nova.compute.manager [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 16 11:13:26 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:13:26 user nova-compute[73067]: DEBUG nova.compute.manager [req-d74fff2c-e09e-46c0-a26d-36883c871583 req-4f9633c6-2f35-4af7-880e-141a6dcbb3bd service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Received event network-vif-deleted-44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:13:26 user nova-compute[73067]: INFO nova.compute.manager [req-d74fff2c-e09e-46c0-a26d-36883c871583 req-4f9633c6-2f35-4af7-880e-141a6dcbb3bd service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Neutron deleted interface 44084712-c9a2-44ef-9b57-9d0b58a0565a; detaching it from the instance and deleting it from the info cache
Aug 16 11:13:26 user nova-compute[73067]: DEBUG nova.network.neutron [req-d74fff2c-e09e-46c0-a26d-36883c871583 req-4f9633c6-2f35-4af7-880e-141a6dcbb3bd service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:13:26 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Took 0.54 seconds to deallocate network for instance.
Aug 16 11:13:26 user nova-compute[73067]: DEBUG nova.compute.manager [req-d74fff2c-e09e-46c0-a26d-36883c871583 req-4f9633c6-2f35-4af7-880e-141a6dcbb3bd service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Detach interface failed, port_id=44084712-c9a2-44ef-9b57-9d0b58a0565a, reason: Instance 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 11:13:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-108e7793-9dfc-4eaf-a663-870b8a5fb51b req-738ed563-2a26-4274-9a83-783d7876011f service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Received event network-vif-plugged-44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:13:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-108e7793-9dfc-4eaf-a663-870b8a5fb51b req-738ed563-2a26-4274-9a83-783d7876011f service nova] Acquiring lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:13:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-108e7793-9dfc-4eaf-a663-870b8a5fb51b req-738ed563-2a26-4274-9a83-783d7876011f service nova] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:13:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-108e7793-9dfc-4eaf-a663-870b8a5fb51b req-738ed563-2a26-4274-9a83-783d7876011f service nova] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:13:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-108e7793-9dfc-4eaf-a663-870b8a5fb51b req-738ed563-2a26-4274-9a83-783d7876011f service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] No waiting events found dispatching network-vif-plugged-44084712-c9a2-44ef-9b57-9d0b58a0565a {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:13:27 user nova-compute[73067]: WARNING nova.compute.manager [req-108e7793-9dfc-4eaf-a663-870b8a5fb51b req-738ed563-2a26-4274-9a83-783d7876011f service nova] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Received unexpected event network-vif-plugged-44084712-c9a2-44ef-9b57-9d0b58a0565a for instance with vm_state active and task_state deleting.
Aug 16 11:13:27 user nova-compute[73067]: INFO nova.compute.manager [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Took 0.80 seconds to detach 1 volumes for instance.
Aug 16 11:13:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Deleting volume: fce110d0-6efd-4bfa-b61d-4888ddfd3f28 {{(pid=73067) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 11:13:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:13:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:13:27 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:13:27 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:13:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:13:27 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Deleted allocations for instance 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a
Aug 16 11:13:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-5067b8ca-e2d7-42fc-811b-d01f7610902f tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "0f829733-ad3e-4dc4-b38d-3ccbdc727e6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.089s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:13:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:13:40 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692184405.7884185, 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:13:40 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] VM Stopped (Lifecycle Event)
Aug 16 11:13:40 user nova-compute[73067]: DEBUG nova.compute.manager [None req-6e8b30c4-bf3c-4ae4-9a4c-265c3104f068 None None] [instance: 0f829733-ad3e-4dc4-b38d-3ccbdc727e6a] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:13:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:13:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:13:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:03 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:14:05 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:14:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:14:08 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:14:09 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:14:09 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:14:09 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=25.166839599609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:14:09 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:14:10 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:14:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:14:13 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:14:13 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:14:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:14:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:14:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:14:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:14:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:14:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:14:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:14:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:14:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:14:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:14:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:14:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:14:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:14:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:14:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:14:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:14:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:14:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:14:38 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:14:38 user nova-compute[73067]: INFO nova.compute.claims [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Claim successful on node user
Aug 16 11:14:38 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:14:38 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:14:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.179s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:14:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:14:39 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:14:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG nova.policy [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bda8cdb53a94455a9a666ad43d60434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a30d2208752496280dd6347a3fcd87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:14:39 user nova-compute[73067]: INFO nova.virt.block_device [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Booting with volume 453e2559-4a5c-4b10-9e72-24f35418fc43 at /dev/vda
Aug 16 11:14:39 user nova-compute[73067]: DEBUG os_brick.utils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f456add-99b9-4fb0-8c69-fef076feb016]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e0483-40e4-4d30-9c0e-ddfe05b64248]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d151a641-c3dc-43a8-a5b6-b0d872dad040]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9156bf-96a3-46d8-bc30-7417a72af108]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:14:39 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:14:39 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5eb32a-e661-47d7-b8c8-641da5ffc36d]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG os_brick.utils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updating existing volume attachment record: e4b3ec71-b01f-40c4-a1c7-687a04010d41 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:14:39 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Successfully created port: 44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Successfully updated port: 44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquired lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-92436ef7-567a-4333-908c-7ad61c8f0a10 req-3626e38b-9d37-494d-be3a-af5ea8bed75e service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received event network-changed-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG nova.compute.manager [req-92436ef7-567a-4333-908c-7ad61c8f0a10 req-3626e38b-9d37-494d-be3a-af5ea8bed75e service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Refreshing instance network info cache due to event network-changed-44694b88-b4c2-4ad7-8e7a-036648004b18. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-92436ef7-567a-4333-908c-7ad61c8f0a10 req-3626e38b-9d37-494d-be3a-af5ea8bed75e service nova] Acquiring lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG nova.network.neutron [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updating instance_info_cache with network_info: [{"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Releasing lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Instance network_info: |[{"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-92436ef7-567a-4333-908c-7ad61c8f0a10 req-3626e38b-9d37-494d-be3a-af5ea8bed75e service nova] Acquired lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:14:40 user nova-compute[73067]: DEBUG nova.network.neutron [req-92436ef7-567a-4333-908c-7ad61c8f0a10 req-3626e38b-9d37-494d-be3a-af5ea8bed75e service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Refreshing network info cache for port 44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:14:41 user nova-compute[73067]: DEBUG nova.network.neutron [req-92436ef7-567a-4333-908c-7ad61c8f0a10 req-3626e38b-9d37-494d-be3a-af5ea8bed75e service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updated VIF entry in instance network info cache for port 44694b88-b4c2-4ad7-8e7a-036648004b18. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:14:41 user nova-compute[73067]: DEBUG nova.network.neutron [req-92436ef7-567a-4333-908c-7ad61c8f0a10 req-3626e38b-9d37-494d-be3a-af5ea8bed75e service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updating instance_info_cache with network_info: [{"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:14:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-92436ef7-567a-4333-908c-7ad61c8f0a10 req-3626e38b-9d37-494d-be3a-af5ea8bed75e service nova] Releasing lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:14:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:14:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Creating image(s)
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Ensure instance console log exists: /opt/stack/data/nova/instances/65eba41a-948b-4bbf-ab11-6d24f8f6c46b/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Start _get_guest_xml network_info=[{"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSXjGFqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65eba41a-948b-4bbf-ab11-6d24f8f6c46b', 'attached_at': '', 'detached_at': '', 'volume_id': '453e2559-4a5c-4b10-9e72-24f35418fc43', 'serial': '453e2559-4a5c-4b10-9e72-24f35418fc43'}, 'delete_on_termination': True, 'attachment_id': 'e4b3ec71-b01f-40c4-a1c7-687a04010d41', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:14:49 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:14:49 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSXjGFqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:14:49 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:14:49 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:14:49 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf5f01b-e3ef-405b-b92f-d90c352ff3e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:14:49 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a773a359-934a-4aef-8865-2389c4747144]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43] added
Aug 16 11:14:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9a0511-48cf-41ee-961d-f5a4a75c921c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[62643408-f40a-452d-b6f5-dc09fbb70d87]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BSXjGFqp {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BSXjGFqp" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1997623b-e1e0-4fb6-87c7-eddfa858507e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BSXjGFqp'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57b3b89-312d-4169-89f7-afe06244b8ce]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0a00d4-41e7-4c6c-a525-9a36e9269e49]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:14:49 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:14:49 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:14:49 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 11:14:49 user nova-compute[73067]: 
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc39cfe-ecd8-4cea-a6fe-ee6369417ab9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43, portal: 172.16.0.220,3260]
Aug 16 11:14:49 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43, portal: 172.16.0.220,3260] successful.
Aug 16 11:14:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[84410b50-b1e0-43e2-9b9e-16637422de8c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbaf0e0-4e6c-4928-9d3c-c924493825ff]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)
Aug 16 11:14:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)
Aug 16 11:14:49 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c4e240-a22a-4abd-a2aa-74e396a72f15]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:14:49 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSXjGFqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23533323466386632', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533323466386632', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-228812217',display_name='tempest-TestVolumeBootPattern-volume-backed-server-228812217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-228812217',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwurI/eZYfE0sQMndcueCwChx8d4X+BZQEGH9Sq5qAVY7I0nXSeK8RApP1ebiPgsJqrGnkbmNs529SLELE40pVoI9gQYoFoSskaVjtzNsfSgFAXK6xP6FIXM/ecdSMnQ==',key_name='tempest-keypair-1870930531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-kwg7ev0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=65eba41a-948b-4bbf-ab11-6d24f8f6c46b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cd:2e,bridge_name='br-int',has_traffic_filtering=True,id=44694b88-b4c2-4ad7-8e7a-036648004b18,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44694b88-b4') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'pci_devices' on Instance uuid 65eba41a-948b-4bbf-ab11-6d24f8f6c46b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:14:50 user nova-compute[73067]:   <uuid>65eba41a-948b-4bbf-ab11-6d24f8f6c46b</uuid>
Aug 16 11:14:50 user nova-compute[73067]:   <name>instance-0000002f</name>
Aug 16 11:14:50 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:14:50 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:14:50 user nova-compute[73067]:   <metadata>
Aug 16 11:14:50 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:14:50 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:14:50 user nova-compute[73067]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-228812217</nova:name>
Aug 16 11:14:50 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:14:49</nova:creationTime>
Aug 16 11:14:50 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:14:50 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:14:50 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:14:50 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:14:50 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:14:50 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:14:50 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:14:50 user nova-compute[73067]:       <nova:owner>
Aug 16 11:14:50 user nova-compute[73067]:         <nova:user uuid="0bda8cdb53a94455a9a666ad43d60434">tempest-TestVolumeBootPattern-1996305180-project-member</nova:user>
Aug 16 11:14:50 user nova-compute[73067]:         <nova:project uuid="1a30d2208752496280dd6347a3fcd87d">tempest-TestVolumeBootPattern-1996305180</nova:project>
Aug 16 11:14:50 user nova-compute[73067]:       </nova:owner>
Aug 16 11:14:50 user nova-compute[73067]:       <nova:ports>
Aug 16 11:14:50 user nova-compute[73067]:         <nova:port uuid="44694b88-b4c2-4ad7-8e7a-036648004b18">
Aug 16 11:14:50 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 11:14:50 user nova-compute[73067]:         </nova:port>
Aug 16 11:14:50 user nova-compute[73067]:       </nova:ports>
Aug 16 11:14:50 user nova-compute[73067]:     </nova:instance>
Aug 16 11:14:50 user nova-compute[73067]:   </metadata>
Aug 16 11:14:50 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:14:50 user nova-compute[73067]:     <system>
Aug 16 11:14:50 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:14:50 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:14:50 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:14:50 user nova-compute[73067]:       <entry name="serial">65eba41a-948b-4bbf-ab11-6d24f8f6c46b</entry>
Aug 16 11:14:50 user nova-compute[73067]:       <entry name="uuid">65eba41a-948b-4bbf-ab11-6d24f8f6c46b</entry>
Aug 16 11:14:50 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:14:50 user nova-compute[73067]:     </system>
Aug 16 11:14:50 user nova-compute[73067]:   </sysinfo>
Aug 16 11:14:50 user nova-compute[73067]:   <os>
Aug 16 11:14:50 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:14:50 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:14:50 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:14:50 user nova-compute[73067]:   </os>
Aug 16 11:14:50 user nova-compute[73067]:   <features>
Aug 16 11:14:50 user nova-compute[73067]:     <acpi/>
Aug 16 11:14:50 user nova-compute[73067]:     <apic/>
Aug 16 11:14:50 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:14:50 user nova-compute[73067]:   </features>
Aug 16 11:14:50 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:14:50 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:14:50 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:14:50 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:14:50 user nova-compute[73067]:   </clock>
Aug 16 11:14:50 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:14:50 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:14:50 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:14:50 user nova-compute[73067]:   </cpu>
Aug 16 11:14:50 user nova-compute[73067]:   <devices>
Aug 16 11:14:50 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 11:14:50 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:14:50 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 11:14:50 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:14:50 user nova-compute[73067]:       <serial>453e2559-4a5c-4b10-9e72-24f35418fc43</serial>
Aug 16 11:14:50 user nova-compute[73067]:     </disk>
Aug 16 11:14:50 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:14:50 user nova-compute[73067]:       <mac address="fa:16:3e:4b:cd:2e"/>
Aug 16 11:14:50 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:14:50 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:14:50 user nova-compute[73067]:       <target dev="tap44694b88-b4"/>
Aug 16 11:14:50 user nova-compute[73067]:     </interface>
Aug 16 11:14:50 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:14:50 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/65eba41a-948b-4bbf-ab11-6d24f8f6c46b/console.log" append="off"/>
Aug 16 11:14:50 user nova-compute[73067]:     </serial>
Aug 16 11:14:50 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:14:50 user nova-compute[73067]:     <video>
Aug 16 11:14:50 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:14:50 user nova-compute[73067]:     </video>
Aug 16 11:14:50 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:14:50 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:14:50 user nova-compute[73067]:     </rng>
Aug 16 11:14:50 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:14:50 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:14:50 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:14:50 user nova-compute[73067]:     </memballoon>
Aug 16 11:14:50 user nova-compute[73067]:   </devices>
Aug 16 11:14:50 user nova-compute[73067]: </domain>
Aug 16 11:14:50 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-228812217',display_name='tempest-TestVolumeBootPattern-volume-backed-server-228812217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-228812217',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwurI/eZYfE0sQMndcueCwChx8d4X+BZQEGH9Sq5qAVY7I0nXSeK8RApP1ebiPgsJqrGnkbmNs529SLELE40pVoI9gQYoFoSskaVjtzNsfSgFAXK6xP6FIXM/ecdSMnQ==',key_name='tempest-keypair-1870930531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-kwg7ev0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=65eba41a-948b-4bbf-ab11-6d24f8f6c46b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cd:2e,bridge_name='br-int',has_traffic_filtering=True,id=44694b88-b4c2-4ad7-8e7a-036648004b18,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44694b88-b4') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG os_vif [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cd:2e,bridge_name='br-int',has_traffic_filtering=True,id=44694b88-b4c2-4ad7-8e7a-036648004b18,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44694b88-b4') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44694b88-b4, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44694b88-b4, col_values=(('external_ids', {'iface-id': '44694b88-b4c2-4ad7-8e7a-036648004b18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:cd:2e', 'vm-uuid': '65eba41a-948b-4bbf-ab11-6d24f8f6c46b'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:50 user nova-compute[73067]: INFO os_vif [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cd:2e,bridge_name='br-int',has_traffic_filtering=True,id=44694b88-b4c2-4ad7-8e7a-036648004b18,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44694b88-b4')
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:14:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No VIF found with MAC fa:16:3e:4b:cd:2e, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:14:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-d60e4671-34ab-4732-8f9c-1c9d6ac8affc req-322214ea-8a1a-40e1-ab0d-df3c030b8362 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received event network-vif-plugged-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:14:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d60e4671-34ab-4732-8f9c-1c9d6ac8affc req-322214ea-8a1a-40e1-ab0d-df3c030b8362 service nova] Acquiring lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:14:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d60e4671-34ab-4732-8f9c-1c9d6ac8affc req-322214ea-8a1a-40e1-ab0d-df3c030b8362 service nova] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:14:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-d60e4671-34ab-4732-8f9c-1c9d6ac8affc req-322214ea-8a1a-40e1-ab0d-df3c030b8362 service nova] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:14:52 user nova-compute[73067]: DEBUG nova.compute.manager [req-d60e4671-34ab-4732-8f9c-1c9d6ac8affc req-322214ea-8a1a-40e1-ab0d-df3c030b8362 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] No waiting events found dispatching network-vif-plugged-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:14:52 user nova-compute[73067]: WARNING nova.compute.manager [req-d60e4671-34ab-4732-8f9c-1c9d6ac8affc req-322214ea-8a1a-40e1-ab0d-df3c030b8362 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received unexpected event network-vif-plugged-44694b88-b4c2-4ad7-8e7a-036648004b18 for instance with vm_state building and task_state spawning.
Aug 16 11:14:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:53 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184493.997593, 65eba41a-948b-4bbf-ab11-6d24f8f6c46b => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:14:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] VM Resumed (Lifecycle Event)
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:14:54 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Instance spawned successfully.
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:14:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184493.9990284, 65eba41a-948b-4bbf-ab11-6d24f8f6c46b => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:14:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] VM Started (Lifecycle Event)
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:14:54 user nova-compute[73067]: INFO nova.compute.manager [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.compute.manager [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:14:54 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.compute.manager [req-df9f5b2c-a8b9-4a71-8855-237cdb2386ea req-c70d91ae-a51e-4593-86e2-ec80dfe11043 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received event network-vif-plugged-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-df9f5b2c-a8b9-4a71-8855-237cdb2386ea req-c70d91ae-a51e-4593-86e2-ec80dfe11043 service nova] Acquiring lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-df9f5b2c-a8b9-4a71-8855-237cdb2386ea req-c70d91ae-a51e-4593-86e2-ec80dfe11043 service nova] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-df9f5b2c-a8b9-4a71-8855-237cdb2386ea req-c70d91ae-a51e-4593-86e2-ec80dfe11043 service nova] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:14:54 user nova-compute[73067]: DEBUG nova.compute.manager [req-df9f5b2c-a8b9-4a71-8855-237cdb2386ea req-c70d91ae-a51e-4593-86e2-ec80dfe11043 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] No waiting events found dispatching network-vif-plugged-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:14:54 user nova-compute[73067]: WARNING nova.compute.manager [req-df9f5b2c-a8b9-4a71-8855-237cdb2386ea req-c70d91ae-a51e-4593-86e2-ec80dfe11043 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received unexpected event network-vif-plugged-44694b88-b4c2-4ad7-8e7a-036648004b18 for instance with vm_state active and task_state None.
Aug 16 11:14:54 user nova-compute[73067]: INFO nova.compute.manager [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Took 15.42 seconds to build instance.
Aug 16 11:14:54 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9c4d9865-b822-4dad-bffa-f94d518e0413 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.518s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:14:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:14:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:04 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:15:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:15:08 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:15:10 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:15:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:15:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:15:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:15:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:15:11 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:15:11 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:15:11 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8727MB free_disk=25.16473388671875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 65eba41a-948b-4bbf-ab11-6d24f8f6c46b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:15:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:15:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:13 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:15:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:15:13 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:15:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:15:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:15:13 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:15:13 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 65eba41a-948b-4bbf-ab11-6d24f8f6c46b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:15:14 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updating instance_info_cache with network_info: [{"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:15:14 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:15:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:15:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:15:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:15:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:15:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:15:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:15:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:15:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:15:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:15:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:15:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:15:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:15:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:15:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:15:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:15:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:15:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:15:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:15:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:15:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:16:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:16:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:16:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:16:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:16:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:06 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:07 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:09 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:10 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:10 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:16:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:16:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:16:13 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:16:13 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:16:13 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=25.156291961669922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 65eba41a-948b-4bbf-ab11-6d24f8f6c46b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:16:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:16:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:14 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 65eba41a-948b-4bbf-ab11-6d24f8f6c46b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updating instance_info_cache with network_info: [{"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:16:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:16:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:19 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:16:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 65eba41a-948b-4bbf-ab11-6d24f8f6c46b {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-a0290c25-0cd7-4001-8022-5322ebbb2f62 req-6515e657-ad30-408f-93d7-133f5e2210e5 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received event network-changed-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-a0290c25-0cd7-4001-8022-5322ebbb2f62 req-6515e657-ad30-408f-93d7-133f5e2210e5 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Refreshing instance network info cache due to event network-changed-44694b88-b4c2-4ad7-8e7a-036648004b18. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a0290c25-0cd7-4001-8022-5322ebbb2f62 req-6515e657-ad30-408f-93d7-133f5e2210e5 service nova] Acquiring lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a0290c25-0cd7-4001-8022-5322ebbb2f62 req-6515e657-ad30-408f-93d7-133f5e2210e5 service nova] Acquired lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:16:30 user nova-compute[73067]: DEBUG nova.network.neutron [req-a0290c25-0cd7-4001-8022-5322ebbb2f62 req-6515e657-ad30-408f-93d7-133f5e2210e5 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Refreshing network info cache for port 44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:16:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-a0290c25-0cd7-4001-8022-5322ebbb2f62 req-6515e657-ad30-408f-93d7-133f5e2210e5 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updated VIF entry in instance network info cache for port 44694b88-b4c2-4ad7-8e7a-036648004b18. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:16:31 user nova-compute[73067]: DEBUG nova.network.neutron [req-a0290c25-0cd7-4001-8022-5322ebbb2f62 req-6515e657-ad30-408f-93d7-133f5e2210e5 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updating instance_info_cache with network_info: [{"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:16:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a0290c25-0cd7-4001-8022-5322ebbb2f62 req-6515e657-ad30-408f-93d7-133f5e2210e5 service nova] Releasing lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:16:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:38 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:16:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 11:16:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 11:16:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:16:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:16:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:16:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:16:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:16:42 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:16:42 user nova-compute[73067]: INFO nova.compute.claims [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Claim successful on node user
Aug 16 11:16:43 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:16:43 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:16:43 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:16:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:16:43 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:16:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:16:43 user nova-compute[73067]: DEBUG nova.network.neutron [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:16:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:16:43 user nova-compute[73067]: INFO nova.virt.block_device [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Booting with volume snapshot 3a0d7fd7-b210-4e92-8853-e9f2debb02d6 at /dev/vda
Aug 16 11:16:43 user nova-compute[73067]: DEBUG nova.policy [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bda8cdb53a94455a9a666ad43d60434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a30d2208752496280dd6347a3fcd87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:16:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Successfully created port: 96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:16:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Successfully updated port: 96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:16:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:16:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquired lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:16:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:16:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:16:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-ed2f08bd-69d0-48dd-84a4-6ab48aba2ab6 req-5ef026f1-497f-4773-b128-1efd981fc6a8 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-changed-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:16:44 user nova-compute[73067]: DEBUG nova.compute.manager [req-ed2f08bd-69d0-48dd-84a4-6ab48aba2ab6 req-5ef026f1-497f-4773-b128-1efd981fc6a8 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Refreshing instance network info cache due to event network-changed-96deba16-783e-43c6-87e2-9daea4711278. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:16:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ed2f08bd-69d0-48dd-84a4-6ab48aba2ab6 req-5ef026f1-497f-4773-b128-1efd981fc6a8 service nova] Acquiring lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG nova.network.neutron [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Updating instance_info_cache with network_info: [{"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Releasing lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Instance network_info: |[{"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ed2f08bd-69d0-48dd-84a4-6ab48aba2ab6 req-5ef026f1-497f-4773-b128-1efd981fc6a8 service nova] Acquired lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG nova.network.neutron [req-ed2f08bd-69d0-48dd-84a4-6ab48aba2ab6 req-5ef026f1-497f-4773-b128-1efd981fc6a8 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Refreshing network info cache for port 96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG nova.network.neutron [req-ed2f08bd-69d0-48dd-84a4-6ab48aba2ab6 req-5ef026f1-497f-4773-b128-1efd981fc6a8 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Updated VIF entry in instance network info cache for port 96deba16-783e-43c6-87e2-9daea4711278. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG nova.network.neutron [req-ed2f08bd-69d0-48dd-84a4-6ab48aba2ab6 req-5ef026f1-497f-4773-b128-1efd981fc6a8 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Updating instance_info_cache with network_info: [{"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:16:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ed2f08bd-69d0-48dd-84a4-6ab48aba2ab6 req-5ef026f1-497f-4773-b128-1efd981fc6a8 service nova] Releasing lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:16:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG os_brick.utils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6261cb-40d3-4cd8-9330-8baaee113f66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[782bc44c-0c94-4254-9837-05d6760c883d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a62bb1-f8ce-4816-91bb-306582a84d79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[482bf982-9d9a-4ede-902d-dd71a04ac77d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:16:49 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:16:49 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff47a3a1-ea4d-49d6-b385-a86246b90fca]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG os_brick.utils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:16:49 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Updating existing volume attachment record: d6f88f7b-20c5-4881-9a51-150d1bf30ae8 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:16:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:16:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:16:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:16:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:16:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:16:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:17:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:17:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:17:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:17:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:17:05 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Creating image(s)
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Ensure instance console log exists: /opt/stack/data/nova/instances/9d7522dd-85e1-48b0-8516-14e36b743fb7/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Start _get_guest_xml network_info=[{"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T11:16:32Z,direct_url=<?>,disk_format='qcow2',id=e5c1b444-de0c-42c7-b791-4e3ec86eb478,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-620751180',owner='1a30d2208752496280dd6347a3fcd87d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T11:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFHfhcbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d7522dd-85e1-48b0-8516-14e36b743fb7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6674e1a-b63f-48fd-98f2-94d48e8dba8d', 'serial': 'c6674e1a-b63f-48fd-98f2-94d48e8dba8d'}, 'delete_on_termination': True, 'attachment_id': 'd6f88f7b-20c5-4881-9a51-150d1bf30ae8', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:17:05 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:17:05 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T11:16:32Z,direct_url=<?>,disk_format='qcow2',id=e5c1b444-de0c-42c7-b791-4e3ec86eb478,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-620751180',owner='1a30d2208752496280dd6347a3fcd87d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T11:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFHfhcbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:17:05 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:17:05 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:17:05 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe87505-0dd1-49a9-8517-6bbe175f8b47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:17:05 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1734ae8-3555-4ce1-88c4-a947c3c174ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d] added
Aug 16 11:17:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37cdb79-1abd-47c4-91dd-8185f4a4dc91]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c08493-5acf-4e05-95c8-6e88adeb45b9]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFHfhcbk {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFHfhcbk" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d94047a-3c9f-4fa3-8b49-12eb57933c86]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oFHfhcbk'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea2f09-3a73-4b72-98b9-82222451540e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9b82ac-71b2-420b-975c-56b908eabc07]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)
Aug 16 11:17:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)
Aug 16 11:17:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ee8c63-e2bf-4214-ae82-3834b291a591]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d, portal: 172.16.0.220,3260]
Aug 16 11:17:05 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d, portal: 172.16.0.220,3260] successful.
Aug 16 11:17:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaf8318-4b5c-4c8c-bb93-8a20166e5fed]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3489a5cf-d4e1-4459-a1f2-25e076cf02fc]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)
Aug 16 11:17:05 user nova-compute[73067]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d (non-flash)
Aug 16 11:17:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)
Aug 16 11:17:05 user nova-compute[73067]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d (non-flash)
Aug 16 11:17:05 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb8d74b-b6be-44e1-b083-24143116af37]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:17:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFHfhcbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23931653236613732', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931653236613732', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1300391583',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1300391583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1300391583',id=48,image_ref='e5c1b444-de0c-42c7-b791-4e3ec86eb478',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcBvzrv5M4iwyYLMKMJ5mVNwv/NChizC9mC0VhukkNR53REE4Nnuezkr+z507LhXY4Kisw0dt6LBXIQoRB6dVuyKt4XYt5vOhJfwgDGeSmMfU8tv+rFuciu96nh/3ZRBw==',key_name='tempest-keypair-1804242526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-z266122y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1996305180',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=9d7522dd-85e1-48b0-8516-14e36b743fb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=96deba16-783e-43c6-87e2-9daea4711278,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96deba16-78') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.objects.instance [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d7522dd-85e1-48b0-8516-14e36b743fb7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:17:06 user nova-compute[73067]:   <uuid>9d7522dd-85e1-48b0-8516-14e36b743fb7</uuid>
Aug 16 11:17:06 user nova-compute[73067]:   <name>instance-00000030</name>
Aug 16 11:17:06 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:17:06 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:17:06 user nova-compute[73067]:   <metadata>
Aug 16 11:17:06 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:17:06 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:17:06 user nova-compute[73067]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1300391583</nova:name>
Aug 16 11:17:06 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:17:05</nova:creationTime>
Aug 16 11:17:06 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:17:06 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:17:06 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:17:06 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:17:06 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:17:06 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:17:06 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:17:06 user nova-compute[73067]:       <nova:owner>
Aug 16 11:17:06 user nova-compute[73067]:         <nova:user uuid="0bda8cdb53a94455a9a666ad43d60434">tempest-TestVolumeBootPattern-1996305180-project-member</nova:user>
Aug 16 11:17:06 user nova-compute[73067]:         <nova:project uuid="1a30d2208752496280dd6347a3fcd87d">tempest-TestVolumeBootPattern-1996305180</nova:project>
Aug 16 11:17:06 user nova-compute[73067]:       </nova:owner>
Aug 16 11:17:06 user nova-compute[73067]:       <nova:root type="image" uuid="e5c1b444-de0c-42c7-b791-4e3ec86eb478"/>
Aug 16 11:17:06 user nova-compute[73067]:       <nova:ports>
Aug 16 11:17:06 user nova-compute[73067]:         <nova:port uuid="96deba16-783e-43c6-87e2-9daea4711278">
Aug 16 11:17:06 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 11:17:06 user nova-compute[73067]:         </nova:port>
Aug 16 11:17:06 user nova-compute[73067]:       </nova:ports>
Aug 16 11:17:06 user nova-compute[73067]:     </nova:instance>
Aug 16 11:17:06 user nova-compute[73067]:   </metadata>
Aug 16 11:17:06 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:17:06 user nova-compute[73067]:     <system>
Aug 16 11:17:06 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:17:06 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:17:06 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:17:06 user nova-compute[73067]:       <entry name="serial">9d7522dd-85e1-48b0-8516-14e36b743fb7</entry>
Aug 16 11:17:06 user nova-compute[73067]:       <entry name="uuid">9d7522dd-85e1-48b0-8516-14e36b743fb7</entry>
Aug 16 11:17:06 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:17:06 user nova-compute[73067]:     </system>
Aug 16 11:17:06 user nova-compute[73067]:   </sysinfo>
Aug 16 11:17:06 user nova-compute[73067]:   <os>
Aug 16 11:17:06 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:17:06 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:17:06 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:17:06 user nova-compute[73067]:   </os>
Aug 16 11:17:06 user nova-compute[73067]:   <features>
Aug 16 11:17:06 user nova-compute[73067]:     <acpi/>
Aug 16 11:17:06 user nova-compute[73067]:     <apic/>
Aug 16 11:17:06 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:17:06 user nova-compute[73067]:   </features>
Aug 16 11:17:06 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:17:06 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:17:06 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:17:06 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:17:06 user nova-compute[73067]:   </clock>
Aug 16 11:17:06 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:17:06 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:17:06 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:17:06 user nova-compute[73067]:   </cpu>
Aug 16 11:17:06 user nova-compute[73067]:   <devices>
Aug 16 11:17:06 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 11:17:06 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:17:06 user nova-compute[73067]:       <source dev="/dev/sdc"/>
Aug 16 11:17:06 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:17:06 user nova-compute[73067]:       <serial>c6674e1a-b63f-48fd-98f2-94d48e8dba8d</serial>
Aug 16 11:17:06 user nova-compute[73067]:     </disk>
Aug 16 11:17:06 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:17:06 user nova-compute[73067]:       <mac address="fa:16:3e:7e:4e:18"/>
Aug 16 11:17:06 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:17:06 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:17:06 user nova-compute[73067]:       <target dev="tap96deba16-78"/>
Aug 16 11:17:06 user nova-compute[73067]:     </interface>
Aug 16 11:17:06 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:17:06 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/9d7522dd-85e1-48b0-8516-14e36b743fb7/console.log" append="off"/>
Aug 16 11:17:06 user nova-compute[73067]:     </serial>
Aug 16 11:17:06 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:17:06 user nova-compute[73067]:     <video>
Aug 16 11:17:06 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:17:06 user nova-compute[73067]:     </video>
Aug 16 11:17:06 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:17:06 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:17:06 user nova-compute[73067]:     </rng>
Aug 16 11:17:06 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:17:06 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:17:06 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:17:06 user nova-compute[73067]:     </memballoon>
Aug 16 11:17:06 user nova-compute[73067]:   </devices>
Aug 16 11:17:06 user nova-compute[73067]: </domain>
Aug 16 11:17:06 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1300391583',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1300391583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1300391583',id=48,image_ref='e5c1b444-de0c-42c7-b791-4e3ec86eb478',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcBvzrv5M4iwyYLMKMJ5mVNwv/NChizC9mC0VhukkNR53REE4Nnuezkr+z507LhXY4Kisw0dt6LBXIQoRB6dVuyKt4XYt5vOhJfwgDGeSmMfU8tv+rFuciu96nh/3ZRBw==',key_name='tempest-keypair-1804242526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-z266122y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1996305180',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=9d7522dd-85e1-48b0-8516-14e36b743fb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=96deba16-783e-43c6-87e2-9daea4711278,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96deba16-78') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG os_vif [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=96deba16-783e-43c6-87e2-9daea4711278,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96deba16-78') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96deba16-78, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96deba16-78, col_values=(('external_ids', {'iface-id': '96deba16-783e-43c6-87e2-9daea4711278', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:4e:18', 'vm-uuid': '9d7522dd-85e1-48b0-8516-14e36b743fb7'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:06 user nova-compute[73067]: INFO os_vif [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=96deba16-783e-43c6-87e2-9daea4711278,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96deba16-78')
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:17:06 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No VIF found with MAC fa:16:3e:7e:4e:18, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:17:07 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:17:07 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:17:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-a4ca698a-d443-4c15-9ae5-efa058483b4b req-31308fe1-e8bb-4ec1-8bee-5db54f30dca4 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:17:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a4ca698a-d443-4c15-9ae5-efa058483b4b req-31308fe1-e8bb-4ec1-8bee-5db54f30dca4 service nova] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:17:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a4ca698a-d443-4c15-9ae5-efa058483b4b req-31308fe1-e8bb-4ec1-8bee-5db54f30dca4 service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:17:08 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a4ca698a-d443-4c15-9ae5-efa058483b4b req-31308fe1-e8bb-4ec1-8bee-5db54f30dca4 service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:17:08 user nova-compute[73067]: DEBUG nova.compute.manager [req-a4ca698a-d443-4c15-9ae5-efa058483b4b req-31308fe1-e8bb-4ec1-8bee-5db54f30dca4 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] No waiting events found dispatching network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:17:08 user nova-compute[73067]: WARNING nova.compute.manager [req-a4ca698a-d443-4c15-9ae5-efa058483b4b req-31308fe1-e8bb-4ec1-8bee-5db54f30dca4 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received unexpected event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 for instance with vm_state building and task_state spawning.
Aug 16 11:17:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:09 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184629.963885, 9d7522dd-85e1-48b0-8516-14e36b743fb7 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:17:09 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] VM Resumed (Lifecycle Event)
Aug 16 11:17:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:17:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:17:09 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Instance spawned successfully.
Aug 16 11:17:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:17:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:17:09 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:17:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:17:09 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:17:10 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:17:10 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184629.9673922, 9d7522dd-85e1-48b0-8516-14e36b743fb7 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:17:10 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] VM Started (Lifecycle Event)
Aug 16 11:17:10 user nova-compute[73067]: INFO nova.compute.manager [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Took 4.87 seconds to spawn the instance on the hypervisor.
Aug 16 11:17:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:17:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:17:10 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:17:10 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:17:10 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:17:10 user nova-compute[73067]: INFO nova.compute.manager [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Took 27.26 seconds to build instance.
Aug 16 11:17:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4debf913-5583-4eb8-9f25-df6c9fa94581 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.358s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:17:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-010fddcf-c15b-4b95-b7f3-aac5258d58ec req-cd761d9e-4ef8-42db-959d-2a8a3134a470 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:17:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-010fddcf-c15b-4b95-b7f3-aac5258d58ec req-cd761d9e-4ef8-42db-959d-2a8a3134a470 service nova] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:17:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-010fddcf-c15b-4b95-b7f3-aac5258d58ec req-cd761d9e-4ef8-42db-959d-2a8a3134a470 service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:17:10 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-010fddcf-c15b-4b95-b7f3-aac5258d58ec req-cd761d9e-4ef8-42db-959d-2a8a3134a470 service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:17:10 user nova-compute[73067]: DEBUG nova.compute.manager [req-010fddcf-c15b-4b95-b7f3-aac5258d58ec req-cd761d9e-4ef8-42db-959d-2a8a3134a470 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] No waiting events found dispatching network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:17:10 user nova-compute[73067]: WARNING nova.compute.manager [req-010fddcf-c15b-4b95-b7f3-aac5258d58ec req-cd761d9e-4ef8-42db-959d-2a8a3134a470 service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received unexpected event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 for instance with vm_state active and task_state None.
Aug 16 11:17:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:12 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:17:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 65eba41a-948b-4bbf-ab11-6d24f8f6c46b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updating instance_info_cache with network_info: [{"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:17:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:17:16 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:17:16 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8750MB free_disk=25.154266357421875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 65eba41a-948b-4bbf-ab11-6d24f8f6c46b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 9d7522dd-85e1-48b0-8516-14e36b743fb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:17:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:19 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:17:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:17:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:17:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:17:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:17:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:18:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:18:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:18:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:18:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:08 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:18:09 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:18:10 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:18:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:18:13 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Updating instance_info_cache with network_info: [{"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:18:15 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:18:16 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:18:16 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:18:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=25.15359115600586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 65eba41a-948b-4bbf-ab11-6d24f8f6c46b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 9d7522dd-85e1-48b0-8516-14e36b743fb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:18:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:18:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:18:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:18:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:18:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:18:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:18:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-9642db06-ffc3-40e8-84e8-522cc91275fb req-9fefa0d0-aa05-41e2-b3a9-a388bf03a2bb service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-changed-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:18:33 user nova-compute[73067]: DEBUG nova.compute.manager [req-9642db06-ffc3-40e8-84e8-522cc91275fb req-9fefa0d0-aa05-41e2-b3a9-a388bf03a2bb service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Refreshing instance network info cache due to event network-changed-96deba16-783e-43c6-87e2-9daea4711278. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:18:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9642db06-ffc3-40e8-84e8-522cc91275fb req-9fefa0d0-aa05-41e2-b3a9-a388bf03a2bb service nova] Acquiring lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:18:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9642db06-ffc3-40e8-84e8-522cc91275fb req-9fefa0d0-aa05-41e2-b3a9-a388bf03a2bb service nova] Acquired lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:18:33 user nova-compute[73067]: DEBUG nova.network.neutron [req-9642db06-ffc3-40e8-84e8-522cc91275fb req-9fefa0d0-aa05-41e2-b3a9-a388bf03a2bb service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Refreshing network info cache for port 96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG nova.network.neutron [req-9642db06-ffc3-40e8-84e8-522cc91275fb req-9fefa0d0-aa05-41e2-b3a9-a388bf03a2bb service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Updated VIF entry in instance network info cache for port 96deba16-783e-43c6-87e2-9daea4711278. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG nova.network.neutron [req-9642db06-ffc3-40e8-84e8-522cc91275fb req-9fefa0d0-aa05-41e2-b3a9-a388bf03a2bb service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Updating instance_info_cache with network_info: [{"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9642db06-ffc3-40e8-84e8-522cc91275fb req-9fefa0d0-aa05-41e2-b3a9-a388bf03a2bb service nova] Releasing lock "refresh_cache-9d7522dd-85e1-48b0-8516-14e36b743fb7" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:34 user nova-compute[73067]: INFO nova.compute.manager [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Terminating instance
Aug 16 11:18:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-1c15b6f1-b210-47ca-bff7-d687ab5a6c25 req-4fc039b9-55ec-4128-b46a-63c50cfdda4f service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-unplugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1c15b6f1-b210-47ca-bff7-d687ab5a6c25 req-4fc039b9-55ec-4128-b46a-63c50cfdda4f service nova] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1c15b6f1-b210-47ca-bff7-d687ab5a6c25 req-4fc039b9-55ec-4128-b46a-63c50cfdda4f service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-1c15b6f1-b210-47ca-bff7-d687ab5a6c25 req-4fc039b9-55ec-4128-b46a-63c50cfdda4f service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-1c15b6f1-b210-47ca-bff7-d687ab5a6c25 req-4fc039b9-55ec-4128-b46a-63c50cfdda4f service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] No waiting events found dispatching network-vif-unplugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-1c15b6f1-b210-47ca-bff7-d687ab5a6c25 req-4fc039b9-55ec-4128-b46a-63c50cfdda4f service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-unplugged-96deba16-783e-43c6-87e2-9daea4711278 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:35 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Instance destroyed successfully.
Aug 16 11:18:35 user nova-compute[73067]: DEBUG nova.objects.instance [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'resources' on Instance uuid 9d7522dd-85e1-48b0-8516-14e36b743fb7 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1300391583',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1300391583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1300391583',id=48,image_ref='e5c1b444-de0c-42c7-b791-4e3ec86eb478',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcBvzrv5M4iwyYLMKMJ5mVNwv/NChizC9mC0VhukkNR53REE4Nnuezkr+z507LhXY4Kisw0dt6LBXIQoRB6dVuyKt4XYt5vOhJfwgDGeSmMfU8tv+rFuciu96nh/3ZRBw==',key_name='tempest-keypair-1804242526',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:17:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-z266122y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1996305180',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=9d7522dd-85e1-48b0-8516-14e36b743fb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "96deba16-783e-43c6-87e2-9daea4711278", "address": "fa:16:3e:7e:4e:18", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96deba16-78", "ovs_interfaceid": "96deba16-783e-43c6-87e2-9daea4711278", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=96deba16-783e-43c6-87e2-9daea4711278,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96deba16-78') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_vif [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=96deba16-783e-43c6-87e2-9daea4711278,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96deba16-78') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96deba16-78, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:18:35 user nova-compute[73067]: INFO os_vif [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=96deba16-783e-43c6-87e2-9daea4711278,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96deba16-78')
Aug 16 11:18:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFHfhcbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:18:35 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3153f5-d810-4bca-9e9b-798bf51556d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f6e095-4e82-4d78-9085-279fe2a54a50]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)
Aug 16 11:18:35 user nova-compute[73067]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d (non-flash)
Aug 16 11:18:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)
Aug 16 11:18:35 user nova-compute[73067]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d (non-flash)
Aug 16 11:18:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35447e24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d8a765-6cd2-4fe0-a491-ad551138fcb4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a9fff9-4aee-413c-beb0-03e89f2279e4]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c485d86d-efab-4d7c-a7fd-afc134b38876]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[871708dc-b164-4b4e-bf21-3456b006ac3e]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18fafa1-624b-4f88-a44d-43906220b531]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6fa86e-72de-405d-abce-5ff6c748b3da]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d, portal: 172.16.0.220,3260]
Aug 16 11:18:35 user nova-compute[73067]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d, portal: 172.16.0.220,3260] successful.
Aug 16 11:18:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6674e1a-b63f-48fd-98f2-94d48e8dba8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7fa93b-6183-4d97-b410-2363abd7490f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== disconnect_volume: return (309ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:18:35 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Deleting instance files /opt/stack/data/nova/instances/9d7522dd-85e1-48b0-8516-14e36b743fb7_del
Aug 16 11:18:35 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Deletion of /opt/stack/data/nova/instances/9d7522dd-85e1-48b0-8516-14e36b743fb7_del complete
Aug 16 11:18:35 user nova-compute[73067]: INFO nova.compute.manager [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 16 11:18:35 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:18:36 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Took 1.08 seconds to deallocate network for instance.
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-de26f2ad-2912-4769-a47c-45388c0546bf req-ee3404fb-5615-4fd3-a09b-61c7b1995e3c service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-deleted-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:18:36 user nova-compute[73067]: INFO nova.compute.manager [req-de26f2ad-2912-4769-a47c-45388c0546bf req-ee3404fb-5615-4fd3-a09b-61c7b1995e3c service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Neutron deleted interface 96deba16-783e-43c6-87e2-9daea4711278; detaching it from the instance and deleting it from the info cache
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.network.neutron [req-de26f2ad-2912-4769-a47c-45388c0546bf req-ee3404fb-5615-4fd3-a09b-61c7b1995e3c service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-de26f2ad-2912-4769-a47c-45388c0546bf req-ee3404fb-5615-4fd3-a09b-61c7b1995e3c service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Detach interface failed, port_id=96deba16-783e-43c6-87e2-9daea4711278, reason: Instance 9d7522dd-85e1-48b0-8516-14e36b743fb7 could not be found. {{(pid=73067) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] No waiting events found dispatching network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:18:36 user nova-compute[73067]: WARNING nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received unexpected event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 for instance with vm_state active and task_state deleting.
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] No waiting events found dispatching network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:18:36 user nova-compute[73067]: WARNING nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received unexpected event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 for instance with vm_state active and task_state deleting.
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] No waiting events found dispatching network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:18:36 user nova-compute[73067]: WARNING nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received unexpected event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 for instance with vm_state active and task_state deleting.
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-unplugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] No waiting events found dispatching network-vif-unplugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-unplugged-96deba16-783e-43c6-87e2-9daea4711278 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Acquiring lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:36 user nova-compute[73067]: DEBUG nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] No waiting events found dispatching network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:18:36 user nova-compute[73067]: WARNING nova.compute.manager [req-64679ee4-effe-4927-9a9f-b4224be18f70 req-d1925472-4808-4826-915b-5e3a20b87b9a service nova] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Received unexpected event network-vif-plugged-96deba16-783e-43c6-87e2-9daea4711278 for instance with vm_state active and task_state deleting.
Aug 16 11:18:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:37 user nova-compute[73067]: INFO nova.compute.manager [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Took 0.74 seconds to detach 1 volumes for instance.
Aug 16 11:18:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Deleting volume: c6674e1a-b63f-48fd-98f2-94d48e8dba8d {{(pid=73067) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 11:18:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:18:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:18:37 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:18:37 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:18:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:37 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Deleted allocations for instance 9d7522dd-85e1-48b0-8516-14e36b743fb7
Aug 16 11:18:37 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-d0ce547e-b1f8-480a-bf95-fd833fa5dc35 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "9d7522dd-85e1-48b0-8516-14e36b743fb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.420s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:18:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:18:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:18:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:18:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:18:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:50 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692184715.1413584, 9d7522dd-85e1-48b0-8516-14e36b743fb7 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:18:50 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] VM Stopped (Lifecycle Event)
Aug 16 11:18:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-ec077356-0eae-4599-a72e-4e35683d3bfc None None] [instance: 9d7522dd-85e1-48b0-8516-14e36b743fb7] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:18:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:18:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:18:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:18:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:18:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:18:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:18:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:19:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:19:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:19:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:19:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:19:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:08 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:19:09 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:19:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:19:12 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 65eba41a-948b-4bbf-ab11-6d24f8f6c46b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updating instance_info_cache with network_info: [{"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-65eba41a-948b-4bbf-ab11-6d24f8f6c46b" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:19:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:19:16 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:19:16 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:19:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.152618408203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 65eba41a-948b-4bbf-ab11-6d24f8f6c46b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:19:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:19:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:19:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:19:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:19:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:19:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:19:30 user nova-compute[73067]: INFO nova.compute.manager [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Terminating instance
Aug 16 11:19:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-bf7a1f0f-2d6e-467e-9a17-1862c173a7a2 req-f6f12b96-2c6a-4553-9011-5605dd3cf080 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received event network-vif-unplugged-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bf7a1f0f-2d6e-467e-9a17-1862c173a7a2 req-f6f12b96-2c6a-4553-9011-5605dd3cf080 service nova] Acquiring lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bf7a1f0f-2d6e-467e-9a17-1862c173a7a2 req-f6f12b96-2c6a-4553-9011-5605dd3cf080 service nova] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-bf7a1f0f-2d6e-467e-9a17-1862c173a7a2 req-f6f12b96-2c6a-4553-9011-5605dd3cf080 service nova] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-bf7a1f0f-2d6e-467e-9a17-1862c173a7a2 req-f6f12b96-2c6a-4553-9011-5605dd3cf080 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] No waiting events found dispatching network-vif-unplugged-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG nova.compute.manager [req-bf7a1f0f-2d6e-467e-9a17-1862c173a7a2 req-f6f12b96-2c6a-4553-9011-5605dd3cf080 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received event network-vif-unplugged-44694b88-b4c2-4ad7-8e7a-036648004b18 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:19:30 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Instance destroyed successfully.
Aug 16 11:19:30 user nova-compute[73067]: DEBUG nova.objects.instance [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'resources' on Instance uuid 65eba41a-948b-4bbf-ab11-6d24f8f6c46b {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-228812217',display_name='tempest-TestVolumeBootPattern-volume-backed-server-228812217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-228812217',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwurI/eZYfE0sQMndcueCwChx8d4X+BZQEGH9Sq5qAVY7I0nXSeK8RApP1ebiPgsJqrGnkbmNs529SLELE40pVoI9gQYoFoSskaVjtzNsfSgFAXK6xP6FIXM/ecdSMnQ==',key_name='tempest-keypair-1870930531',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:14:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-kwg7ev0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=65eba41a-948b-4bbf-ab11-6d24f8f6c46b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "44694b88-b4c2-4ad7-8e7a-036648004b18", "address": "fa:16:3e:4b:cd:2e", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44694b88-b4", "ovs_interfaceid": "44694b88-b4c2-4ad7-8e7a-036648004b18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cd:2e,bridge_name='br-int',has_traffic_filtering=True,id=44694b88-b4c2-4ad7-8e7a-036648004b18,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44694b88-b4') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG os_vif [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cd:2e,bridge_name='br-int',has_traffic_filtering=True,id=44694b88-b4c2-4ad7-8e7a-036648004b18,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44694b88-b4') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44694b88-b4, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:19:30 user nova-compute[73067]: INFO os_vif [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cd:2e,bridge_name='br-int',has_traffic_filtering=True,id=44694b88-b4c2-4ad7-8e7a-036648004b18,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44694b88-b4')
Aug 16 11:19:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSXjGFqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:19:30 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:19:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1004ec-4f86-4aa6-bd94-a72307c72d1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdf53ba-cf40-4e97-a5d0-e7f5ab8e3b23]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)
Aug 16 11:19:30 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:19:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 (non-flash)
Aug 16 11:19:30 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35646a0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36bdfaa-2ed5-436a-b89d-13b2f3c9fce5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fc2cdb-fe64-42d1-b503-53cd15594b3a]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c9ae2-2127-4695-87f5-4334126b1f64]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[738dcc59-b600-4304-9211-7c6562f9fa00]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_65520f29', '/dev/disk/by-id/scsi-1SCST_BIO65520f29-5324f8f25071f7f2', '/dev/disk/by-id/scsi-23533323466386632') {{(pid=84181) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b84b23e-dcd0-4971-b178-ad6042ae453d]: (4, None) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4509ef-10c5-429b-868b-5411b3c68071]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b3f12e-2249-4a5c-a61f-ca1b701a7377]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43, portal: 172.16.0.220,3260]
Aug 16 11:19:31 user nova-compute[73067]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43, portal: 172.16.0.220,3260] successful.
Aug 16 11:19:31 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453e2559-4a5c-4b10-9e72-24f35418fc43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[de28bbda-b23e-4261-9ba1-de64bbe2ff1a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== disconnect_volume: return (307ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:19:31 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Deleting instance files /opt/stack/data/nova/instances/65eba41a-948b-4bbf-ab11-6d24f8f6c46b_del
Aug 16 11:19:31 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Deletion of /opt/stack/data/nova/instances/65eba41a-948b-4bbf-ab11-6d24f8f6c46b_del complete
Aug 16 11:19:31 user nova-compute[73067]: INFO nova.compute.manager [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 16 11:19:31 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:19:31 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:19:32 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:19:32 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Took 0.73 seconds to deallocate network for instance.
Aug 16 11:19:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-fb6fcb3b-4269-43a7-b89b-0c01d582e6e4 req-320d7330-c391-4218-adce-51eed9c7cde7 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received event network-vif-plugged-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:19:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fb6fcb3b-4269-43a7-b89b-0c01d582e6e4 req-320d7330-c391-4218-adce-51eed9c7cde7 service nova] Acquiring lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:19:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fb6fcb3b-4269-43a7-b89b-0c01d582e6e4 req-320d7330-c391-4218-adce-51eed9c7cde7 service nova] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:19:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fb6fcb3b-4269-43a7-b89b-0c01d582e6e4 req-320d7330-c391-4218-adce-51eed9c7cde7 service nova] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:19:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-fb6fcb3b-4269-43a7-b89b-0c01d582e6e4 req-320d7330-c391-4218-adce-51eed9c7cde7 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] No waiting events found dispatching network-vif-plugged-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:19:32 user nova-compute[73067]: WARNING nova.compute.manager [req-fb6fcb3b-4269-43a7-b89b-0c01d582e6e4 req-320d7330-c391-4218-adce-51eed9c7cde7 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received unexpected event network-vif-plugged-44694b88-b4c2-4ad7-8e7a-036648004b18 for instance with vm_state active and task_state deleting.
Aug 16 11:19:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-fb6fcb3b-4269-43a7-b89b-0c01d582e6e4 req-320d7330-c391-4218-adce-51eed9c7cde7 service nova] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Received event network-vif-deleted-44694b88-b4c2-4ad7-8e7a-036648004b18 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:19:32 user nova-compute[73067]: INFO nova.compute.manager [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Took 0.78 seconds to detach 1 volumes for instance.
Aug 16 11:19:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Deleting volume: 453e2559-4a5c-4b10-9e72-24f35418fc43 {{(pid=73067) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 11:19:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:19:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:19:33 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:19:33 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:19:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:19:33 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Deleted allocations for instance 65eba41a-948b-4bbf-ab11-6d24f8f6c46b
Aug 16 11:19:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-27fcadef-2f64-4a0b-a23b-a79f65073321 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "65eba41a-948b-4bbf-ab11-6d24f8f6c46b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.028s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:19:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:19:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:19:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:19:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:19:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:19:45 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692184770.9004285, 65eba41a-948b-4bbf-ab11-6d24f8f6c46b => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:19:45 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] VM Stopped (Lifecycle Event)
Aug 16 11:19:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-f289af4a-f694-4486-952b-38e3c997a850 None None] [instance: 65eba41a-948b-4bbf-ab11-6d24f8f6c46b] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:19:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:19:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:19:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:20:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:08 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:20:10 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:20:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:20:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:20:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:20:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:20:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:20:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:20:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:20:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:20:15 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:20:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:20:17 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:20:17 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:20:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=25.15176773071289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:20:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:20:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:20:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:20:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:20:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:20:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:20:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "978b31ed-795f-4843-a150-85aee2a2acf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:20:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "978b31ed-795f-4843-a150-85aee2a2acf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:20:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:20:34 user nova-compute[73067]: INFO nova.compute.claims [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Claim successful on node user
Aug 16 11:20:34 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.186s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:20:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:20:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:20:34 user nova-compute[73067]: INFO nova.virt.block_device [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Booting with volume 98b06f01-f112-4f19-9b02-edfdb02c1075 at /dev/vda
Aug 16 11:20:34 user nova-compute[73067]: DEBUG nova.policy [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bda8cdb53a94455a9a666ad43d60434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a30d2208752496280dd6347a3fcd87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG os_brick.utils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6066a4c5-6c7a-40f6-97ce-3e58bdb40f8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0c9119-92d1-4d01-894a-1ae8b4d4a4cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b810cf-a961-4d3a-bddc-02645388e77c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce3a73-33be-46e8-be91-00bfc0a4240e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:20:34 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:20:34 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbab83e-ac51-4c8b-b39e-cdfc10b46e4a]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG os_brick.utils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:20:34 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updating existing volume attachment record: 5ea08da0-6ce5-4930-9315-1222ff0997d3 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:20:35 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Successfully created port: ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:20:35 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Successfully updated port: ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:20:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:20:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquired lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:20:35 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:20:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-31b6950f-8179-43ae-9bf5-42ac2d1f4259 req-9a2ac12d-5488-4e29-b5b2-e18ed5dc93f9 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received event network-changed-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:20:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-31b6950f-8179-43ae-9bf5-42ac2d1f4259 req-9a2ac12d-5488-4e29-b5b2-e18ed5dc93f9 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Refreshing instance network info cache due to event network-changed-ba41b577-a92a-4357-bb92-2499594682c8. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:20:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-31b6950f-8179-43ae-9bf5-42ac2d1f4259 req-9a2ac12d-5488-4e29-b5b2-e18ed5dc93f9 service nova] Acquiring lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:20:35 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:20:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:20:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updating instance_info_cache with network_info: [{"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:20:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Releasing lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:20:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Instance network_info: |[{"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:20:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-31b6950f-8179-43ae-9bf5-42ac2d1f4259 req-9a2ac12d-5488-4e29-b5b2-e18ed5dc93f9 service nova] Acquired lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:20:36 user nova-compute[73067]: DEBUG nova.network.neutron [req-31b6950f-8179-43ae-9bf5-42ac2d1f4259 req-9a2ac12d-5488-4e29-b5b2-e18ed5dc93f9 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Refreshing network info cache for port ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:20:36 user nova-compute[73067]: DEBUG nova.network.neutron [req-31b6950f-8179-43ae-9bf5-42ac2d1f4259 req-9a2ac12d-5488-4e29-b5b2-e18ed5dc93f9 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updated VIF entry in instance network info cache for port ba41b577-a92a-4357-bb92-2499594682c8. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:20:36 user nova-compute[73067]: DEBUG nova.network.neutron [req-31b6950f-8179-43ae-9bf5-42ac2d1f4259 req-9a2ac12d-5488-4e29-b5b2-e18ed5dc93f9 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updating instance_info_cache with network_info: [{"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:20:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-31b6950f-8179-43ae-9bf5-42ac2d1f4259 req-9a2ac12d-5488-4e29-b5b2-e18ed5dc93f9 service nova] Releasing lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:20:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:20:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Creating image(s)
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Ensure instance console log exists: /opt/stack/data/nova/instances/978b31ed-795f-4843-a150-85aee2a2acf1/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Start _get_guest_xml network_info=[{"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcJCpTgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '978b31ed-795f-4843-a150-85aee2a2acf1', 'attached_at': '', 'detached_at': '', 'volume_id': '98b06f01-f112-4f19-9b02-edfdb02c1075', 'serial': '98b06f01-f112-4f19-9b02-edfdb02c1075'}, 'delete_on_termination': False, 'attachment_id': '5ea08da0-6ce5-4930-9315-1222ff0997d3', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:20:44 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:20:44 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcJCpTgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:20:44 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:20:44 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:20:44 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c904c4-8576-4b3b-a150-fd050e3654bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:20:44 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f21a92b-2ec5-47b2-bcbf-d3d9d6fe5104]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075] added
Aug 16 11:20:44 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[640979b7-a37c-47a0-9656-f71dbcc00aa3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4822ae73-fbe1-401f-81d8-9c1869c82236]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OcJCpTgy {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OcJCpTgy" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6197c92b-f35c-45cb-a0de-e904aadebef3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OcJCpTgy'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9d4eac-c942-4cc1-88a0-db2cb042b7a6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f67718a-9fb9-415d-b7fd-28dbce0223c2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:20:44 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:20:44 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:20:44 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 11:20:44 user nova-compute[73067]: 
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df1e71-000e-49f6-9ee5-165db0435b7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260]
Aug 16 11:20:44 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260] successful.
Aug 16 11:20:44 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d941bb3e-7293-4663-9759-9fcc1da018cf]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcba6a41-5ac6-4210-97d7-30c38483593a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:20:44 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:20:44 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f871f4-fa1d-4b78-adaf-1c683834d61c]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:20:44 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcJCpTgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23138333266363661', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138333266363661', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-181917241',display_name='tempest-TestVolumeBootPattern-server-181917241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-181917241',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfQnOxbelYGJIdPlv6s51762JxUXKbFHXhDmsQD3dwIgXIxov99vjfdOwt0Gqgwb91gXxZXKct7WLStT6hEFTIQPos1L2JcdVgxul8WQsxrQDfjiLlNJauw+kkR7FSPA==',key_name='tempest-TestVolumeBootPattern-747513915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-u809y95d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:20:34Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=978b31ed-795f-4843-a150-85aee2a2acf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:43:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba41b577-a92a-4357-bb92-2499594682c8,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba41b577-a9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.objects.instance [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'pci_devices' on Instance uuid 978b31ed-795f-4843-a150-85aee2a2acf1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:20:45 user nova-compute[73067]:   <uuid>978b31ed-795f-4843-a150-85aee2a2acf1</uuid>
Aug 16 11:20:45 user nova-compute[73067]:   <name>instance-00000031</name>
Aug 16 11:20:45 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:20:45 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:20:45 user nova-compute[73067]:   <metadata>
Aug 16 11:20:45 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:20:45 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:20:45 user nova-compute[73067]:       <nova:name>tempest-TestVolumeBootPattern-server-181917241</nova:name>
Aug 16 11:20:45 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:20:44</nova:creationTime>
Aug 16 11:20:45 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:20:45 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:20:45 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:20:45 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:20:45 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:20:45 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:20:45 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:20:45 user nova-compute[73067]:       <nova:owner>
Aug 16 11:20:45 user nova-compute[73067]:         <nova:user uuid="0bda8cdb53a94455a9a666ad43d60434">tempest-TestVolumeBootPattern-1996305180-project-member</nova:user>
Aug 16 11:20:45 user nova-compute[73067]:         <nova:project uuid="1a30d2208752496280dd6347a3fcd87d">tempest-TestVolumeBootPattern-1996305180</nova:project>
Aug 16 11:20:45 user nova-compute[73067]:       </nova:owner>
Aug 16 11:20:45 user nova-compute[73067]:       <nova:ports>
Aug 16 11:20:45 user nova-compute[73067]:         <nova:port uuid="ba41b577-a92a-4357-bb92-2499594682c8">
Aug 16 11:20:45 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 11:20:45 user nova-compute[73067]:         </nova:port>
Aug 16 11:20:45 user nova-compute[73067]:       </nova:ports>
Aug 16 11:20:45 user nova-compute[73067]:     </nova:instance>
Aug 16 11:20:45 user nova-compute[73067]:   </metadata>
Aug 16 11:20:45 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:20:45 user nova-compute[73067]:     <system>
Aug 16 11:20:45 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:20:45 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:20:45 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:20:45 user nova-compute[73067]:       <entry name="serial">978b31ed-795f-4843-a150-85aee2a2acf1</entry>
Aug 16 11:20:45 user nova-compute[73067]:       <entry name="uuid">978b31ed-795f-4843-a150-85aee2a2acf1</entry>
Aug 16 11:20:45 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:20:45 user nova-compute[73067]:     </system>
Aug 16 11:20:45 user nova-compute[73067]:   </sysinfo>
Aug 16 11:20:45 user nova-compute[73067]:   <os>
Aug 16 11:20:45 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:20:45 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:20:45 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:20:45 user nova-compute[73067]:   </os>
Aug 16 11:20:45 user nova-compute[73067]:   <features>
Aug 16 11:20:45 user nova-compute[73067]:     <acpi/>
Aug 16 11:20:45 user nova-compute[73067]:     <apic/>
Aug 16 11:20:45 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:20:45 user nova-compute[73067]:   </features>
Aug 16 11:20:45 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:20:45 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:20:45 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:20:45 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:20:45 user nova-compute[73067]:   </clock>
Aug 16 11:20:45 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:20:45 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:20:45 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:20:45 user nova-compute[73067]:   </cpu>
Aug 16 11:20:45 user nova-compute[73067]:   <devices>
Aug 16 11:20:45 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 11:20:45 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:20:45 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 11:20:45 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:20:45 user nova-compute[73067]:       <serial>98b06f01-f112-4f19-9b02-edfdb02c1075</serial>
Aug 16 11:20:45 user nova-compute[73067]:     </disk>
Aug 16 11:20:45 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:20:45 user nova-compute[73067]:       <mac address="fa:16:3e:3b:43:b8"/>
Aug 16 11:20:45 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:20:45 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:20:45 user nova-compute[73067]:       <target dev="tapba41b577-a9"/>
Aug 16 11:20:45 user nova-compute[73067]:     </interface>
Aug 16 11:20:45 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:20:45 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/978b31ed-795f-4843-a150-85aee2a2acf1/console.log" append="off"/>
Aug 16 11:20:45 user nova-compute[73067]:     </serial>
Aug 16 11:20:45 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:20:45 user nova-compute[73067]:     <video>
Aug 16 11:20:45 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:20:45 user nova-compute[73067]:     </video>
Aug 16 11:20:45 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:20:45 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:20:45 user nova-compute[73067]:     </rng>
Aug 16 11:20:45 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:20:45 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:20:45 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:20:45 user nova-compute[73067]:     </memballoon>
Aug 16 11:20:45 user nova-compute[73067]:   </devices>
Aug 16 11:20:45 user nova-compute[73067]: </domain>
Aug 16 11:20:45 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-181917241',display_name='tempest-TestVolumeBootPattern-server-181917241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-181917241',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfQnOxbelYGJIdPlv6s51762JxUXKbFHXhDmsQD3dwIgXIxov99vjfdOwt0Gqgwb91gXxZXKct7WLStT6hEFTIQPos1L2JcdVgxul8WQsxrQDfjiLlNJauw+kkR7FSPA==',key_name='tempest-TestVolumeBootPattern-747513915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-u809y95d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:20:34Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=978b31ed-795f-4843-a150-85aee2a2acf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:43:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba41b577-a92a-4357-bb92-2499594682c8,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba41b577-a9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG os_vif [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:43:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba41b577-a92a-4357-bb92-2499594682c8,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba41b577-a9') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba41b577-a9, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba41b577-a9, col_values=(('external_ids', {'iface-id': 'ba41b577-a92a-4357-bb92-2499594682c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:43:b8', 'vm-uuid': '978b31ed-795f-4843-a150-85aee2a2acf1'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:45 user nova-compute[73067]: INFO os_vif [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:43:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba41b577-a92a-4357-bb92-2499594682c8,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba41b577-a9')
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:20:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No VIF found with MAC fa:16:3e:3b:43:b8, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:20:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-e93eea82-3c31-49e9-9720-578de81bf207 req-1f75c467-e757-4e79-8d97-dd680080659a service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received event network-vif-plugged-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:20:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e93eea82-3c31-49e9-9720-578de81bf207 req-1f75c467-e757-4e79-8d97-dd680080659a service nova] Acquiring lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:20:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e93eea82-3c31-49e9-9720-578de81bf207 req-1f75c467-e757-4e79-8d97-dd680080659a service nova] Lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:20:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e93eea82-3c31-49e9-9720-578de81bf207 req-1f75c467-e757-4e79-8d97-dd680080659a service nova] Lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:20:47 user nova-compute[73067]: DEBUG nova.compute.manager [req-e93eea82-3c31-49e9-9720-578de81bf207 req-1f75c467-e757-4e79-8d97-dd680080659a service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] No waiting events found dispatching network-vif-plugged-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:20:47 user nova-compute[73067]: WARNING nova.compute.manager [req-e93eea82-3c31-49e9-9720-578de81bf207 req-1f75c467-e757-4e79-8d97-dd680080659a service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received unexpected event network-vif-plugged-ba41b577-a92a-4357-bb92-2499594682c8 for instance with vm_state building and task_state spawning.
Aug 16 11:20:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184849.0468438, 978b31ed-795f-4843-a150-85aee2a2acf1 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:20:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] VM Resumed (Lifecycle Event)
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:20:49 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Instance spawned successfully.
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:20:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692184849.0490408, 978b31ed-795f-4843-a150-85aee2a2acf1 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:20:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] VM Started (Lifecycle Event)
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:20:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:20:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Took 4.96 seconds to spawn the instance on the hypervisor.
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-ce244b7c-03f7-4ba2-a9fc-518c9b920956 req-8b023f7b-22ad-45e2-95a9-9c0126b5f8a0 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received event network-vif-plugged-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ce244b7c-03f7-4ba2-a9fc-518c9b920956 req-8b023f7b-22ad-45e2-95a9-9c0126b5f8a0 service nova] Acquiring lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ce244b7c-03f7-4ba2-a9fc-518c9b920956 req-8b023f7b-22ad-45e2-95a9-9c0126b5f8a0 service nova] Lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ce244b7c-03f7-4ba2-a9fc-518c9b920956 req-8b023f7b-22ad-45e2-95a9-9c0126b5f8a0 service nova] Lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:20:49 user nova-compute[73067]: DEBUG nova.compute.manager [req-ce244b7c-03f7-4ba2-a9fc-518c9b920956 req-8b023f7b-22ad-45e2-95a9-9c0126b5f8a0 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] No waiting events found dispatching network-vif-plugged-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:20:49 user nova-compute[73067]: WARNING nova.compute.manager [req-ce244b7c-03f7-4ba2-a9fc-518c9b920956 req-8b023f7b-22ad-45e2-95a9-9c0126b5f8a0 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received unexpected event network-vif-plugged-ba41b577-a92a-4357-bb92-2499594682c8 for instance with vm_state building and task_state spawning.
Aug 16 11:20:49 user nova-compute[73067]: INFO nova.compute.manager [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Took 15.23 seconds to build instance.
Aug 16 11:20:49 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-8c818c2e-985e-4989-a5eb-8dfc880ba0c5 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "978b31ed-795f-4843-a150-85aee2a2acf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.322s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:20:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:20:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:21:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:21:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:21:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:21:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:21:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:08 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:11 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:16 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:21:16 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:21:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:21:16 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:21:16 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:21:16 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 978b31ed-795f-4843-a150-85aee2a2acf1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updating instance_info_cache with network_info: [{"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:17 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:21:17 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=25.149532318115234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 978b31ed-795f-4843-a150-85aee2a2acf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:21:17 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:21:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 11:21:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:21:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:21:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:21:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:21:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:21:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:21:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:21:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:21:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:21:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:21:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:21:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:21:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:21:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:21:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:21:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 11:21:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 11:21:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:21:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:21:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:21:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:21:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:21:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:21:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:21:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:22:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:22:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:22:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:22:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:10 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:22:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:22:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:22:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:22:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:12 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:22:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:22:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:22:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:16 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:22:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:22:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:22:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:22:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:22:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:22:18 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:22:18 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 978b31ed-795f-4843-a150-85aee2a2acf1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:22:18 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updating instance_info_cache with network_info: [{"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:22:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:22:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:22:19 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:22:19 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.14897918701172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 978b31ed-795f-4843-a150-85aee2a2acf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:22:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:22:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:22:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:22:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:22:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:22:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:22:26 user nova-compute[73067]: DEBUG nova.compute.manager [req-e3f1c4c0-f3d0-4137-98ae-525283da338b req-d34e5a30-5aa1-40ac-a0ed-626b29a3db36 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received event network-changed-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:22:26 user nova-compute[73067]: DEBUG nova.compute.manager [req-e3f1c4c0-f3d0-4137-98ae-525283da338b req-d34e5a30-5aa1-40ac-a0ed-626b29a3db36 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Refreshing instance network info cache due to event network-changed-ba41b577-a92a-4357-bb92-2499594682c8. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:22:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e3f1c4c0-f3d0-4137-98ae-525283da338b req-d34e5a30-5aa1-40ac-a0ed-626b29a3db36 service nova] Acquiring lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:22:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e3f1c4c0-f3d0-4137-98ae-525283da338b req-d34e5a30-5aa1-40ac-a0ed-626b29a3db36 service nova] Acquired lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:22:26 user nova-compute[73067]: DEBUG nova.network.neutron [req-e3f1c4c0-f3d0-4137-98ae-525283da338b req-d34e5a30-5aa1-40ac-a0ed-626b29a3db36 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Refreshing network info cache for port ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "978b31ed-795f-4843-a150-85aee2a2acf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "978b31ed-795f-4843-a150-85aee2a2acf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:22:27 user nova-compute[73067]: INFO nova.compute.manager [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Terminating instance
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.network.neutron [req-e3f1c4c0-f3d0-4137-98ae-525283da338b req-d34e5a30-5aa1-40ac-a0ed-626b29a3db36 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updated VIF entry in instance network info cache for port ba41b577-a92a-4357-bb92-2499594682c8. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.network.neutron [req-e3f1c4c0-f3d0-4137-98ae-525283da338b req-d34e5a30-5aa1-40ac-a0ed-626b29a3db36 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updating instance_info_cache with network_info: [{"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e3f1c4c0-f3d0-4137-98ae-525283da338b req-d34e5a30-5aa1-40ac-a0ed-626b29a3db36 service nova] Releasing lock "refresh_cache-978b31ed-795f-4843-a150-85aee2a2acf1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-82e3d2a0-ff52-4f16-9e46-20f827c15632 req-afb7db60-074d-484a-b4cb-d8d0e3c11530 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received event network-vif-unplugged-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-82e3d2a0-ff52-4f16-9e46-20f827c15632 req-afb7db60-074d-484a-b4cb-d8d0e3c11530 service nova] Acquiring lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-82e3d2a0-ff52-4f16-9e46-20f827c15632 req-afb7db60-074d-484a-b4cb-d8d0e3c11530 service nova] Lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-82e3d2a0-ff52-4f16-9e46-20f827c15632 req-afb7db60-074d-484a-b4cb-d8d0e3c11530 service nova] Lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-82e3d2a0-ff52-4f16-9e46-20f827c15632 req-afb7db60-074d-484a-b4cb-d8d0e3c11530 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] No waiting events found dispatching network-vif-unplugged-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-82e3d2a0-ff52-4f16-9e46-20f827c15632 req-afb7db60-074d-484a-b4cb-d8d0e3c11530 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received event network-vif-unplugged-ba41b577-a92a-4357-bb92-2499594682c8 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:22:27 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Instance destroyed successfully.
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.objects.instance [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'resources' on Instance uuid 978b31ed-795f-4843-a150-85aee2a2acf1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-181917241',display_name='tempest-TestVolumeBootPattern-server-181917241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-181917241',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfQnOxbelYGJIdPlv6s51762JxUXKbFHXhDmsQD3dwIgXIxov99vjfdOwt0Gqgwb91gXxZXKct7WLStT6hEFTIQPos1L2JcdVgxul8WQsxrQDfjiLlNJauw+kkR7FSPA==',key_name='tempest-TestVolumeBootPattern-747513915',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-u809y95d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:20:49Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=978b31ed-795f-4843-a150-85aee2a2acf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "ba41b577-a92a-4357-bb92-2499594682c8", "address": "fa:16:3e:3b:43:b8", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba41b577-a9", "ovs_interfaceid": "ba41b577-a92a-4357-bb92-2499594682c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:43:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba41b577-a92a-4357-bb92-2499594682c8,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba41b577-a9') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_vif [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:43:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba41b577-a92a-4357-bb92-2499594682c8,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba41b577-a9') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba41b577-a9, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:22:27 user nova-compute[73067]: INFO os_vif [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:43:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba41b577-a92a-4357-bb92-2499594682c8,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba41b577-a9')
Aug 16 11:22:27 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcJCpTgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:22:27 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca91a690-2b38-45e8-bd23-d677a234e0c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bae0a89-238a-4493-b022-a3e57d4cd4be]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:22:27 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:22:27 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f356462f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec6a0da-f9a8-4433-9a35-9b14d5af4796]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1205f1-8d3a-417d-9d5a-fe9f574165c3]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73a366e-de36-49a5-b722-d6b273c3ed1f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:22:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b714feb7-af72-4011-8071-52eb0e75a40d]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c021fc-f6a7-42b3-8fc2-fac44b486d93]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42205a2-c020-4de5-90e6-5236135e8687]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260]
Aug 16 11:22:28 user nova-compute[73067]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260] successful.
Aug 16 11:22:28 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4df58c3-e7d6-4bd5-a709-f2bd36b297ad]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== disconnect_volume: return (253ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:22:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Deleting instance files /opt/stack/data/nova/instances/978b31ed-795f-4843-a150-85aee2a2acf1_del
Aug 16 11:22:28 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Deletion of /opt/stack/data/nova/instances/978b31ed-795f-4843-a150-85aee2a2acf1_del complete
Aug 16 11:22:28 user nova-compute[73067]: INFO nova.compute.manager [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 16 11:22:28 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:22:28 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:22:29 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:22:29 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Took 0.93 seconds to deallocate network for instance.
Aug 16 11:22:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-9a8ed101-d365-4fae-9f9c-11a15ff42c5c req-e9de9b78-e551-49f5-8086-f991ff59dd58 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received event network-vif-plugged-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:22:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9a8ed101-d365-4fae-9f9c-11a15ff42c5c req-e9de9b78-e551-49f5-8086-f991ff59dd58 service nova] Acquiring lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:22:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9a8ed101-d365-4fae-9f9c-11a15ff42c5c req-e9de9b78-e551-49f5-8086-f991ff59dd58 service nova] Lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:22:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-9a8ed101-d365-4fae-9f9c-11a15ff42c5c req-e9de9b78-e551-49f5-8086-f991ff59dd58 service nova] Lock "978b31ed-795f-4843-a150-85aee2a2acf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:22:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-9a8ed101-d365-4fae-9f9c-11a15ff42c5c req-e9de9b78-e551-49f5-8086-f991ff59dd58 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] No waiting events found dispatching network-vif-plugged-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:22:29 user nova-compute[73067]: WARNING nova.compute.manager [req-9a8ed101-d365-4fae-9f9c-11a15ff42c5c req-e9de9b78-e551-49f5-8086-f991ff59dd58 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received unexpected event network-vif-plugged-ba41b577-a92a-4357-bb92-2499594682c8 for instance with vm_state active and task_state deleting.
Aug 16 11:22:29 user nova-compute[73067]: DEBUG nova.compute.manager [req-9a8ed101-d365-4fae-9f9c-11a15ff42c5c req-e9de9b78-e551-49f5-8086-f991ff59dd58 service nova] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Received event network-vif-deleted-ba41b577-a92a-4357-bb92-2499594682c8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:22:29 user nova-compute[73067]: INFO nova.compute.manager [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Took 0.74 seconds to detach 1 volumes for instance.
Aug 16 11:22:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:22:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:22:30 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:22:30 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:22:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:22:30 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Deleted allocations for instance 978b31ed-795f-4843-a150-85aee2a2acf1
Aug 16 11:22:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-95f1248d-68a6-49d4-ba64-e160587c9063 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "978b31ed-795f-4843-a150-85aee2a2acf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.160s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:22:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:22:42 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692184947.8189085, 978b31ed-795f-4843-a150-85aee2a2acf1 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:22:42 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] VM Stopped (Lifecycle Event)
Aug 16 11:22:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-aefbc6af-b403-499c-a408-fade6d3816e6 None None] [instance: 978b31ed-795f-4843-a150-85aee2a2acf1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:22:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:22:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:22:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:22:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:22:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:22:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:23:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:11 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:23:12 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:23:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:23:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:23:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:23:18 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:23:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:23:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:23:18 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:23:18 user nova-compute[73067]: INFO nova.compute.claims [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Claim successful on node user
Aug 16 11:23:19 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:23:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:23:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:23:19 user nova-compute[73067]: INFO nova.virt.block_device [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Booting with volume 98b06f01-f112-4f19-9b02-edfdb02c1075 at /dev/vda
Aug 16 11:23:19 user nova-compute[73067]: DEBUG nova.policy [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bda8cdb53a94455a9a666ad43d60434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a30d2208752496280dd6347a3fcd87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG os_brick.utils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d77a29e-ae5f-43fd-bbb0-86224f4a242d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f466665-ded0-4676-8663-2db9c2b346a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7a1c0d-d2e0-4454-96e8-1e3b399e4aea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[175a1cdd-809a-4d75-94ce-e3aee11d21c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:23:19 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:23:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a958944c-d314-461f-91c1-7af15fde181c]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG os_brick.utils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:23:19 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updating existing volume attachment record: 1af2f942-aa96-4e33-b02c-3797aea70b8c {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:23:20 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Successfully created port: f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:23:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:23:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:23:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:23:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Skipping network cache update for instance because it is Building. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 11:23:20 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:23:20 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Successfully updated port: f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:23:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:23:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquired lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-942dd786-715c-4ec5-a201-b40a0899f940 req-fdccda57-c1c5-41c5-98ca-e0fb9bdad625 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received event network-changed-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-942dd786-715c-4ec5-a201-b40a0899f940 req-fdccda57-c1c5-41c5-98ca-e0fb9bdad625 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Refreshing instance network info cache due to event network-changed-f65b2b98-1d07-4896-87fe-e02c8cd661ac. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-942dd786-715c-4ec5-a201-b40a0899f940 req-fdccda57-c1c5-41c5-98ca-e0fb9bdad625 service nova] Acquiring lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:23:21 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:23:21 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=25.147808074951172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fac55656-3b0c-4034-80ef-b90a0fb15bb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.network.neutron [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updating instance_info_cache with network_info: [{"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Releasing lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Instance network_info: |[{"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-942dd786-715c-4ec5-a201-b40a0899f940 req-fdccda57-c1c5-41c5-98ca-e0fb9bdad625 service nova] Acquired lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.network.neutron [req-942dd786-715c-4ec5-a201-b40a0899f940 req-fdccda57-c1c5-41c5-98ca-e0fb9bdad625 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Refreshing network info cache for port f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:23:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:23:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-942dd786-715c-4ec5-a201-b40a0899f940 req-fdccda57-c1c5-41c5-98ca-e0fb9bdad625 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updated VIF entry in instance network info cache for port f65b2b98-1d07-4896-87fe-e02c8cd661ac. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:23:22 user nova-compute[73067]: DEBUG nova.network.neutron [req-942dd786-715c-4ec5-a201-b40a0899f940 req-fdccda57-c1c5-41c5-98ca-e0fb9bdad625 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updating instance_info_cache with network_info: [{"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:23:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-942dd786-715c-4ec5-a201-b40a0899f940 req-fdccda57-c1c5-41c5-98ca-e0fb9bdad625 service nova] Releasing lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:23:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:23:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:23:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:23:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:23:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:23:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:23:29 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Creating image(s)
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Ensure instance console log exists: /opt/stack/data/nova/instances/fac55656-3b0c-4034-80ef-b90a0fb15bb2/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Start _get_guest_xml network_info=[{"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcJCpTgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fac55656-3b0c-4034-80ef-b90a0fb15bb2', 'attached_at': '', 'detached_at': '', 'volume_id': '98b06f01-f112-4f19-9b02-edfdb02c1075', 'serial': '98b06f01-f112-4f19-9b02-edfdb02c1075'}, 'delete_on_termination': False, 'attachment_id': '1af2f942-aa96-4e33-b02c-3797aea70b8c', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:23:29 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:23:29 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcJCpTgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:23:29 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:23:29 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:23:29 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[deab14a9-f7ac-4b7d-92f2-fe8872c0dda5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:23:29 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3d067e-8a2b-4d8f-81e0-fcc6e04cae4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075] added
Aug 16 11:23:29 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a998c81-1575-4ea2-8b93-fb4a9fed9aa0]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d565414f-89fb-40b7-b1c3-afdc6061fc01]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OcJCpTgy {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OcJCpTgy" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[934db7e0-9b44-4090-b6f7-0a22135002da]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OcJCpTgy'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1016f53-2858-442e-94f5-7d0db02efeba]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[83436f86-2256-4378-89dc-b57acd7805d3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:23:29 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:23:29 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:23:29 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 11:23:29 user nova-compute[73067]: 
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2891b759-a56c-4947-8733-43530dce1401]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260]
Aug 16 11:23:29 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260] successful.
Aug 16 11:23:29 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7cb655-be46-4906-9e46-fe5e536e1d0b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[38949c88-3c89-44aa-a298-abc42c744c53]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:23:29 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:23:29 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[241ddfbd-b674-4c84-83ac-03786e8e7492]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:23:29 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcJCpTgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23138333266363661', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138333266363661', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-820958866',display_name='tempest-TestVolumeBootPattern-server-820958866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-820958866',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfQnOxbelYGJIdPlv6s51762JxUXKbFHXhDmsQD3dwIgXIxov99vjfdOwt0Gqgwb91gXxZXKct7WLStT6hEFTIQPos1L2JcdVgxul8WQsxrQDfjiLlNJauw+kkR7FSPA==',key_name='tempest-TestVolumeBootPattern-747513915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-cfbkz2iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:23:19Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=fac55656-3b0c-4034-80ef-b90a0fb15bb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f65b2b98-1d07-4896-87fe-e02c8cd661ac,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf65b2b98-1d') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.objects.instance [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'pci_devices' on Instance uuid fac55656-3b0c-4034-80ef-b90a0fb15bb2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:23:30 user nova-compute[73067]:   <uuid>fac55656-3b0c-4034-80ef-b90a0fb15bb2</uuid>
Aug 16 11:23:30 user nova-compute[73067]:   <name>instance-00000032</name>
Aug 16 11:23:30 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:23:30 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:23:30 user nova-compute[73067]:   <metadata>
Aug 16 11:23:30 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:23:30 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:23:30 user nova-compute[73067]:       <nova:name>tempest-TestVolumeBootPattern-server-820958866</nova:name>
Aug 16 11:23:30 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:23:29</nova:creationTime>
Aug 16 11:23:30 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:23:30 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:23:30 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:23:30 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:23:30 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:23:30 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:23:30 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:23:30 user nova-compute[73067]:       <nova:owner>
Aug 16 11:23:30 user nova-compute[73067]:         <nova:user uuid="0bda8cdb53a94455a9a666ad43d60434">tempest-TestVolumeBootPattern-1996305180-project-member</nova:user>
Aug 16 11:23:30 user nova-compute[73067]:         <nova:project uuid="1a30d2208752496280dd6347a3fcd87d">tempest-TestVolumeBootPattern-1996305180</nova:project>
Aug 16 11:23:30 user nova-compute[73067]:       </nova:owner>
Aug 16 11:23:30 user nova-compute[73067]:       <nova:ports>
Aug 16 11:23:30 user nova-compute[73067]:         <nova:port uuid="f65b2b98-1d07-4896-87fe-e02c8cd661ac">
Aug 16 11:23:30 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 11:23:30 user nova-compute[73067]:         </nova:port>
Aug 16 11:23:30 user nova-compute[73067]:       </nova:ports>
Aug 16 11:23:30 user nova-compute[73067]:     </nova:instance>
Aug 16 11:23:30 user nova-compute[73067]:   </metadata>
Aug 16 11:23:30 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:23:30 user nova-compute[73067]:     <system>
Aug 16 11:23:30 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:23:30 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:23:30 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:23:30 user nova-compute[73067]:       <entry name="serial">fac55656-3b0c-4034-80ef-b90a0fb15bb2</entry>
Aug 16 11:23:30 user nova-compute[73067]:       <entry name="uuid">fac55656-3b0c-4034-80ef-b90a0fb15bb2</entry>
Aug 16 11:23:30 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:23:30 user nova-compute[73067]:     </system>
Aug 16 11:23:30 user nova-compute[73067]:   </sysinfo>
Aug 16 11:23:30 user nova-compute[73067]:   <os>
Aug 16 11:23:30 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:23:30 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:23:30 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:23:30 user nova-compute[73067]:   </os>
Aug 16 11:23:30 user nova-compute[73067]:   <features>
Aug 16 11:23:30 user nova-compute[73067]:     <acpi/>
Aug 16 11:23:30 user nova-compute[73067]:     <apic/>
Aug 16 11:23:30 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:23:30 user nova-compute[73067]:   </features>
Aug 16 11:23:30 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:23:30 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:23:30 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:23:30 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:23:30 user nova-compute[73067]:   </clock>
Aug 16 11:23:30 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:23:30 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:23:30 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:23:30 user nova-compute[73067]:   </cpu>
Aug 16 11:23:30 user nova-compute[73067]:   <devices>
Aug 16 11:23:30 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 11:23:30 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:23:30 user nova-compute[73067]:       <source dev="/dev/sdb"/>
Aug 16 11:23:30 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:23:30 user nova-compute[73067]:       <serial>98b06f01-f112-4f19-9b02-edfdb02c1075</serial>
Aug 16 11:23:30 user nova-compute[73067]:     </disk>
Aug 16 11:23:30 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:23:30 user nova-compute[73067]:       <mac address="fa:16:3e:bb:c8:b1"/>
Aug 16 11:23:30 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:23:30 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:23:30 user nova-compute[73067]:       <target dev="tapf65b2b98-1d"/>
Aug 16 11:23:30 user nova-compute[73067]:     </interface>
Aug 16 11:23:30 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:23:30 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/fac55656-3b0c-4034-80ef-b90a0fb15bb2/console.log" append="off"/>
Aug 16 11:23:30 user nova-compute[73067]:     </serial>
Aug 16 11:23:30 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:23:30 user nova-compute[73067]:     <video>
Aug 16 11:23:30 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:23:30 user nova-compute[73067]:     </video>
Aug 16 11:23:30 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:23:30 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:23:30 user nova-compute[73067]:     </rng>
Aug 16 11:23:30 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:23:30 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:23:30 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:23:30 user nova-compute[73067]:     </memballoon>
Aug 16 11:23:30 user nova-compute[73067]:   </devices>
Aug 16 11:23:30 user nova-compute[73067]: </domain>
Aug 16 11:23:30 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-820958866',display_name='tempest-TestVolumeBootPattern-server-820958866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-820958866',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfQnOxbelYGJIdPlv6s51762JxUXKbFHXhDmsQD3dwIgXIxov99vjfdOwt0Gqgwb91gXxZXKct7WLStT6hEFTIQPos1L2JcdVgxul8WQsxrQDfjiLlNJauw+kkR7FSPA==',key_name='tempest-TestVolumeBootPattern-747513915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-cfbkz2iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:23:19Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=fac55656-3b0c-4034-80ef-b90a0fb15bb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f65b2b98-1d07-4896-87fe-e02c8cd661ac,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf65b2b98-1d') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG os_vif [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f65b2b98-1d07-4896-87fe-e02c8cd661ac,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf65b2b98-1d') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf65b2b98-1d, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf65b2b98-1d, col_values=(('external_ids', {'iface-id': 'f65b2b98-1d07-4896-87fe-e02c8cd661ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:c8:b1', 'vm-uuid': 'fac55656-3b0c-4034-80ef-b90a0fb15bb2'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:23:30 user nova-compute[73067]: INFO os_vif [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f65b2b98-1d07-4896-87fe-e02c8cd661ac,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf65b2b98-1d')
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:23:30 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No VIF found with MAC fa:16:3e:bb:c8:b1, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-6cdaa5fa-1877-45e1-bd81-8c5c9a034098 req-e0d2ae6f-737c-4760-9248-4fcaeaf04fe5 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received event network-vif-plugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6cdaa5fa-1877-45e1-bd81-8c5c9a034098 req-e0d2ae6f-737c-4760-9248-4fcaeaf04fe5 service nova] Acquiring lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6cdaa5fa-1877-45e1-bd81-8c5c9a034098 req-e0d2ae6f-737c-4760-9248-4fcaeaf04fe5 service nova] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6cdaa5fa-1877-45e1-bd81-8c5c9a034098 req-e0d2ae6f-737c-4760-9248-4fcaeaf04fe5 service nova] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG nova.compute.manager [req-6cdaa5fa-1877-45e1-bd81-8c5c9a034098 req-e0d2ae6f-737c-4760-9248-4fcaeaf04fe5 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] No waiting events found dispatching network-vif-plugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:23:32 user nova-compute[73067]: WARNING nova.compute.manager [req-6cdaa5fa-1877-45e1-bd81-8c5c9a034098 req-e0d2ae6f-737c-4760-9248-4fcaeaf04fe5 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received unexpected event network-vif-plugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac for instance with vm_state building and task_state spawning.
Aug 16 11:23:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692185014.0935197, fac55656-3b0c-4034-80ef-b90a0fb15bb2 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:23:34 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] VM Resumed (Lifecycle Event)
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:23:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Instance spawned successfully.
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:23:34 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692185014.0953667, fac55656-3b0c-4034-80ef-b90a0fb15bb2 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:23:34 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] VM Started (Lifecycle Event)
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:23:34 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:23:34 user nova-compute[73067]: INFO nova.compute.manager [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Took 4.95 seconds to spawn the instance on the hypervisor.
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:23:34 user nova-compute[73067]: INFO nova.compute.manager [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Took 15.37 seconds to build instance.
Aug 16 11:23:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-7556fec5-5122-4980-9db7-7c87a5826673 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.459s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-f6920650-7f81-4bb1-8419-59b4e97f8267 req-0e775218-9871-4b18-ad2e-a2114d218aac service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received event network-vif-plugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f6920650-7f81-4bb1-8419-59b4e97f8267 req-0e775218-9871-4b18-ad2e-a2114d218aac service nova] Acquiring lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f6920650-7f81-4bb1-8419-59b4e97f8267 req-0e775218-9871-4b18-ad2e-a2114d218aac service nova] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-f6920650-7f81-4bb1-8419-59b4e97f8267 req-0e775218-9871-4b18-ad2e-a2114d218aac service nova] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:23:34 user nova-compute[73067]: DEBUG nova.compute.manager [req-f6920650-7f81-4bb1-8419-59b4e97f8267 req-0e775218-9871-4b18-ad2e-a2114d218aac service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] No waiting events found dispatching network-vif-plugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:23:34 user nova-compute[73067]: WARNING nova.compute.manager [req-f6920650-7f81-4bb1-8419-59b4e97f8267 req-0e775218-9871-4b18-ad2e-a2114d218aac service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received unexpected event network-vif-plugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac for instance with vm_state active and task_state None.
Aug 16 11:23:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:23:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:23:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:23:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:23:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:23:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:23:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:23:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:23:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:23:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:24:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:24:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:24:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:12 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:24:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:24:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:24:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:24:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:24:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:24:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:24:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid fac55656-3b0c-4034-80ef-b90a0fb15bb2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updating instance_info_cache with network_info: [{"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:24:21 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:24:23 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:24:23 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:24:23 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.146373748779297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fac55656-3b0c-4034-80ef-b90a0fb15bb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:24:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:24:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:24:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:24:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:27 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:24:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:24:29 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:24:30 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:24:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:24:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:24:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:24:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:24:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:24:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:24:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:24:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:24:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:24:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:24:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:24:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:25:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:25:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:25:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:25:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:25:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:25:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:25:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:25:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:25:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-57d292b3-23de-4741-b7da-9960a80e4154 req-d65d6640-c123-4ea6-af60-045b9198fcdb service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received event network-changed-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:25:11 user nova-compute[73067]: DEBUG nova.compute.manager [req-57d292b3-23de-4741-b7da-9960a80e4154 req-d65d6640-c123-4ea6-af60-045b9198fcdb service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Refreshing instance network info cache due to event network-changed-f65b2b98-1d07-4896-87fe-e02c8cd661ac. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:25:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-57d292b3-23de-4741-b7da-9960a80e4154 req-d65d6640-c123-4ea6-af60-045b9198fcdb service nova] Acquiring lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:25:11 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-57d292b3-23de-4741-b7da-9960a80e4154 req-d65d6640-c123-4ea6-af60-045b9198fcdb service nova] Acquired lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:25:11 user nova-compute[73067]: DEBUG nova.network.neutron [req-57d292b3-23de-4741-b7da-9960a80e4154 req-d65d6640-c123-4ea6-af60-045b9198fcdb service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Refreshing network info cache for port f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:25:12 user nova-compute[73067]: DEBUG nova.network.neutron [req-57d292b3-23de-4741-b7da-9960a80e4154 req-d65d6640-c123-4ea6-af60-045b9198fcdb service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updated VIF entry in instance network info cache for port f65b2b98-1d07-4896-87fe-e02c8cd661ac. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:25:12 user nova-compute[73067]: DEBUG nova.network.neutron [req-57d292b3-23de-4741-b7da-9960a80e4154 req-d65d6640-c123-4ea6-af60-045b9198fcdb service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updating instance_info_cache with network_info: [{"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:25:12 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-57d292b3-23de-4741-b7da-9960a80e4154 req-d65d6640-c123-4ea6-af60-045b9198fcdb service nova] Releasing lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:25:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:13 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:25:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:25:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:25:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:21 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:25:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:25:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid fac55656-3b0c-4034-80ef-b90a0fb15bb2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updating instance_info_cache with network_info: [{"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:25:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:25:24 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:25:24 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:25:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=25.145526885986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:25:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:25:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:25:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fac55656-3b0c-4034-80ef-b90a0fb15bb2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:25:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:25:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:25:24 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:25:24 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:25:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:25:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:25:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "afd6bec0-6e94-4778-829e-1304233f9ac9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:25:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:25:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:25:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:25:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:25:25 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:25:25 user nova-compute[73067]: INFO nova.compute.claims [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Claim successful on node user
Aug 16 11:25:26 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG nova.network.neutron [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:25:26 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:25:26 user nova-compute[73067]: DEBUG nova.compute.manager [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:25:26 user nova-compute[73067]: INFO nova.virt.block_device [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Booting with volume 07be5ce3-81e3-4a22-b81c-2103af8d43eb at /dev/vda
Aug 16 11:25:26 user nova-compute[73067]: DEBUG nova.policy [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bda8cdb53a94455a9a666ad43d60434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a30d2208752496280dd6347a3fcd87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG os_brick.utils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccffd2e5-93ce-4bfa-b60c-2d50f7b02057]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ff047b-a3d3-4829-8217-09527a9a21e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d512db-44c4-495a-9056-17305b309275]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b26345a-34d0-48b2-b9d5-b1458f575d86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:25:26 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:25:26 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba87933-0779-4d33-9182-5d5d4a48a9aa]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG os_brick.utils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Updating existing volume attachment record: cffcf585-1f83-440b-9683-2e1ea16ea5a1 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:25:26 user nova-compute[73067]: DEBUG nova.network.neutron [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Successfully created port: 6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:25:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Successfully updated port: 6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:25:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:25:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquired lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:25:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:25:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-5d94c43c-ff16-47a8-a17f-9542cb1e72c2 req-28ad4acf-8366-4716-87e9-4bd7028ddcad service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received event network-changed-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:25:27 user nova-compute[73067]: DEBUG nova.compute.manager [req-5d94c43c-ff16-47a8-a17f-9542cb1e72c2 req-28ad4acf-8366-4716-87e9-4bd7028ddcad service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Refreshing instance network info cache due to event network-changed-6ee9e1df-9a69-49e7-9e97-7b29c719cf11. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:25:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5d94c43c-ff16-47a8-a17f-9542cb1e72c2 req-28ad4acf-8366-4716-87e9-4bd7028ddcad service nova] Acquiring lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:25:27 user nova-compute[73067]: DEBUG nova.network.neutron [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:25:28 user nova-compute[73067]: DEBUG nova.network.neutron [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Updating instance_info_cache with network_info: [{"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:25:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Releasing lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:25:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Instance network_info: |[{"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:25:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5d94c43c-ff16-47a8-a17f-9542cb1e72c2 req-28ad4acf-8366-4716-87e9-4bd7028ddcad service nova] Acquired lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:25:28 user nova-compute[73067]: DEBUG nova.network.neutron [req-5d94c43c-ff16-47a8-a17f-9542cb1e72c2 req-28ad4acf-8366-4716-87e9-4bd7028ddcad service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Refreshing network info cache for port 6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:25:28 user nova-compute[73067]: DEBUG nova.network.neutron [req-5d94c43c-ff16-47a8-a17f-9542cb1e72c2 req-28ad4acf-8366-4716-87e9-4bd7028ddcad service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Updated VIF entry in instance network info cache for port 6ee9e1df-9a69-49e7-9e97-7b29c719cf11. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:25:28 user nova-compute[73067]: DEBUG nova.network.neutron [req-5d94c43c-ff16-47a8-a17f-9542cb1e72c2 req-28ad4acf-8366-4716-87e9-4bd7028ddcad service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Updating instance_info_cache with network_info: [{"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:25:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5d94c43c-ff16-47a8-a17f-9542cb1e72c2 req-28ad4acf-8366-4716-87e9-4bd7028ddcad service nova] Releasing lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:25:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:25:29 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:25:30 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:25:30 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:25:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:25:36 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Creating image(s)
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Did not create local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Ensure instance console log exists: /opt/stack/data/nova/instances/afd6bec0-6e94-4778-829e-1304233f9ac9/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Start _get_guest_xml network_info=[{"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCeorpaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'afd6bec0-6e94-4778-829e-1304233f9ac9', 'attached_at': '', 'detached_at': '', 'volume_id': '07be5ce3-81e3-4a22-b81c-2103af8d43eb', 'serial': '07be5ce3-81e3-4a22-b81c-2103af8d43eb'}, 'delete_on_termination': False, 'attachment_id': 'cffcf585-1f83-440b-9683-2e1ea16ea5a1', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:25:36 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:25:36 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCeorpaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:25:36 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:25:36 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:25:36 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[42db6383-3104-4e42-ac17-88e54a5f26c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:25:36 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff886dc3-6173-4aea-877d-8b86d1e123a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb] added
Aug 16 11:25:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03f72fd-725f-4ed9-8a08-5f40428cdd79]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab865ac8-3c68-4680-8ad8-4a28827b07f6]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCeorpaB {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCeorpaB" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0b6d6e-cc5e-4e74-b511-28d886f95533]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mCeorpaB'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53779bf-190e-4477-bb7c-ea8e7adbed44]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5193105a-4edd-461f-a896-c1dba3c87bde]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:25:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:25:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6414a0d-ad4e-4e1a-9ee5-70421ee86779]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb, portal: 172.16.0.220,3260]
Aug 16 11:25:36 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb, portal: 172.16.0.220,3260] successful.
Aug 16 11:25:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[78676909-a413-4475-8f99-07be1d1ceb1c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9029b8d4-06b7-4ffe-a12a-186ef307fe92]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:25:36 user nova-compute[73067]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb (non-flash)
Aug 16 11:25:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:25:36 user nova-compute[73067]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb (non-flash)
Aug 16 11:25:36 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[641ffc59-50a5-4cc0-b1b2-518183846520]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:25:36 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCeorpaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23564323337633630', 'path': '/dev/sdc'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564323337633630', 'path': '/dev/sdc'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-620203371',display_name='tempest-TestVolumeBootPattern-server-620203371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-620203371',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfQnOxbelYGJIdPlv6s51762JxUXKbFHXhDmsQD3dwIgXIxov99vjfdOwt0Gqgwb91gXxZXKct7WLStT6hEFTIQPos1L2JcdVgxul8WQsxrQDfjiLlNJauw+kkR7FSPA==',key_name='tempest-TestVolumeBootPattern-747513915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-4fkbjk61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:25:26Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=afd6bec0-6e94-4778-829e-1304233f9ac9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:57:fc,bridge_name='br-int',has_traffic_filtering=True,id=6ee9e1df-9a69-49e7-9e97-7b29c719cf11,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee9e1df-9a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.objects.instance [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'pci_devices' on Instance uuid afd6bec0-6e94-4778-829e-1304233f9ac9 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:25:37 user nova-compute[73067]:   <uuid>afd6bec0-6e94-4778-829e-1304233f9ac9</uuid>
Aug 16 11:25:37 user nova-compute[73067]:   <name>instance-00000033</name>
Aug 16 11:25:37 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:25:37 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:25:37 user nova-compute[73067]:   <metadata>
Aug 16 11:25:37 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:25:37 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:25:37 user nova-compute[73067]:       <nova:name>tempest-TestVolumeBootPattern-server-620203371</nova:name>
Aug 16 11:25:37 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:25:36</nova:creationTime>
Aug 16 11:25:37 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:25:37 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:25:37 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:25:37 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:25:37 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:25:37 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:25:37 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:25:37 user nova-compute[73067]:       <nova:owner>
Aug 16 11:25:37 user nova-compute[73067]:         <nova:user uuid="0bda8cdb53a94455a9a666ad43d60434">tempest-TestVolumeBootPattern-1996305180-project-member</nova:user>
Aug 16 11:25:37 user nova-compute[73067]:         <nova:project uuid="1a30d2208752496280dd6347a3fcd87d">tempest-TestVolumeBootPattern-1996305180</nova:project>
Aug 16 11:25:37 user nova-compute[73067]:       </nova:owner>
Aug 16 11:25:37 user nova-compute[73067]:       <nova:ports>
Aug 16 11:25:37 user nova-compute[73067]:         <nova:port uuid="6ee9e1df-9a69-49e7-9e97-7b29c719cf11">
Aug 16 11:25:37 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 11:25:37 user nova-compute[73067]:         </nova:port>
Aug 16 11:25:37 user nova-compute[73067]:       </nova:ports>
Aug 16 11:25:37 user nova-compute[73067]:     </nova:instance>
Aug 16 11:25:37 user nova-compute[73067]:   </metadata>
Aug 16 11:25:37 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:25:37 user nova-compute[73067]:     <system>
Aug 16 11:25:37 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:25:37 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:25:37 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:25:37 user nova-compute[73067]:       <entry name="serial">afd6bec0-6e94-4778-829e-1304233f9ac9</entry>
Aug 16 11:25:37 user nova-compute[73067]:       <entry name="uuid">afd6bec0-6e94-4778-829e-1304233f9ac9</entry>
Aug 16 11:25:37 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:25:37 user nova-compute[73067]:     </system>
Aug 16 11:25:37 user nova-compute[73067]:   </sysinfo>
Aug 16 11:25:37 user nova-compute[73067]:   <os>
Aug 16 11:25:37 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:25:37 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:25:37 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:25:37 user nova-compute[73067]:   </os>
Aug 16 11:25:37 user nova-compute[73067]:   <features>
Aug 16 11:25:37 user nova-compute[73067]:     <acpi/>
Aug 16 11:25:37 user nova-compute[73067]:     <apic/>
Aug 16 11:25:37 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:25:37 user nova-compute[73067]:   </features>
Aug 16 11:25:37 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:25:37 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:25:37 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:25:37 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:25:37 user nova-compute[73067]:   </clock>
Aug 16 11:25:37 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:25:37 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:25:37 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:25:37 user nova-compute[73067]:   </cpu>
Aug 16 11:25:37 user nova-compute[73067]:   <devices>
Aug 16 11:25:37 user nova-compute[73067]:     <disk type="block" device="disk">
Aug 16 11:25:37 user nova-compute[73067]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:25:37 user nova-compute[73067]:       <source dev="/dev/sdc"/>
Aug 16 11:25:37 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:25:37 user nova-compute[73067]:       <serial>07be5ce3-81e3-4a22-b81c-2103af8d43eb</serial>
Aug 16 11:25:37 user nova-compute[73067]:     </disk>
Aug 16 11:25:37 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:25:37 user nova-compute[73067]:       <mac address="fa:16:3e:4d:57:fc"/>
Aug 16 11:25:37 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:25:37 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:25:37 user nova-compute[73067]:       <target dev="tap6ee9e1df-9a"/>
Aug 16 11:25:37 user nova-compute[73067]:     </interface>
Aug 16 11:25:37 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:25:37 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/afd6bec0-6e94-4778-829e-1304233f9ac9/console.log" append="off"/>
Aug 16 11:25:37 user nova-compute[73067]:     </serial>
Aug 16 11:25:37 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:25:37 user nova-compute[73067]:     <video>
Aug 16 11:25:37 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:25:37 user nova-compute[73067]:     </video>
Aug 16 11:25:37 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:25:37 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:25:37 user nova-compute[73067]:     </rng>
Aug 16 11:25:37 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:25:37 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:25:37 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:25:37 user nova-compute[73067]:     </memballoon>
Aug 16 11:25:37 user nova-compute[73067]:   </devices>
Aug 16 11:25:37 user nova-compute[73067]: </domain>
Aug 16 11:25:37 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-620203371',display_name='tempest-TestVolumeBootPattern-server-620203371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-620203371',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfQnOxbelYGJIdPlv6s51762JxUXKbFHXhDmsQD3dwIgXIxov99vjfdOwt0Gqgwb91gXxZXKct7WLStT6hEFTIQPos1L2JcdVgxul8WQsxrQDfjiLlNJauw+kkR7FSPA==',key_name='tempest-TestVolumeBootPattern-747513915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-4fkbjk61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:25:26Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=afd6bec0-6e94-4778-829e-1304233f9ac9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:57:fc,bridge_name='br-int',has_traffic_filtering=True,id=6ee9e1df-9a69-49e7-9e97-7b29c719cf11,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee9e1df-9a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG os_vif [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:57:fc,bridge_name='br-int',has_traffic_filtering=True,id=6ee9e1df-9a69-49e7-9e97-7b29c719cf11,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee9e1df-9a') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ee9e1df-9a, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ee9e1df-9a, col_values=(('external_ids', {'iface-id': '6ee9e1df-9a69-49e7-9e97-7b29c719cf11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:57:fc', 'vm-uuid': 'afd6bec0-6e94-4778-829e-1304233f9ac9'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:37 user nova-compute[73067]: INFO os_vif [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:57:fc,bridge_name='br-int',has_traffic_filtering=True,id=6ee9e1df-9a69-49e7-9e97-7b29c719cf11,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee9e1df-9a')
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:25:37 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] No VIF found with MAC fa:16:3e:4d:57:fc, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:25:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-91299af6-dcc2-4fc6-a393-0053fd58e449 req-cb5836ee-6d86-4842-b61a-f65412f2f63b service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received event network-vif-plugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:25:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-91299af6-dcc2-4fc6-a393-0053fd58e449 req-cb5836ee-6d86-4842-b61a-f65412f2f63b service nova] Acquiring lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:25:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-91299af6-dcc2-4fc6-a393-0053fd58e449 req-cb5836ee-6d86-4842-b61a-f65412f2f63b service nova] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:25:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-91299af6-dcc2-4fc6-a393-0053fd58e449 req-cb5836ee-6d86-4842-b61a-f65412f2f63b service nova] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:25:39 user nova-compute[73067]: DEBUG nova.compute.manager [req-91299af6-dcc2-4fc6-a393-0053fd58e449 req-cb5836ee-6d86-4842-b61a-f65412f2f63b service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] No waiting events found dispatching network-vif-plugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:25:39 user nova-compute[73067]: WARNING nova.compute.manager [req-91299af6-dcc2-4fc6-a393-0053fd58e449 req-cb5836ee-6d86-4842-b61a-f65412f2f63b service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received unexpected event network-vif-plugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 for instance with vm_state building and task_state spawning.
Aug 16 11:25:39 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692185141.0771985, afd6bec0-6e94-4778-829e-1304233f9ac9 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:25:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] VM Resumed (Lifecycle Event)
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:25:41 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Instance spawned successfully.
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:25:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692185141.079361, afd6bec0-6e94-4778-829e-1304233f9ac9 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:25:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] VM Started (Lifecycle Event)
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:25:41 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:25:41 user nova-compute[73067]: INFO nova.compute.manager [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Took 4.93 seconds to spawn the instance on the hypervisor.
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-b45c0ffa-c0a2-41f7-99a4-74bb372746c0 req-be297866-cbfa-4f21-bc5c-014aff8c8750 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received event network-vif-plugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b45c0ffa-c0a2-41f7-99a4-74bb372746c0 req-be297866-cbfa-4f21-bc5c-014aff8c8750 service nova] Acquiring lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b45c0ffa-c0a2-41f7-99a4-74bb372746c0 req-be297866-cbfa-4f21-bc5c-014aff8c8750 service nova] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-b45c0ffa-c0a2-41f7-99a4-74bb372746c0 req-be297866-cbfa-4f21-bc5c-014aff8c8750 service nova] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:25:41 user nova-compute[73067]: DEBUG nova.compute.manager [req-b45c0ffa-c0a2-41f7-99a4-74bb372746c0 req-be297866-cbfa-4f21-bc5c-014aff8c8750 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] No waiting events found dispatching network-vif-plugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:25:41 user nova-compute[73067]: WARNING nova.compute.manager [req-b45c0ffa-c0a2-41f7-99a4-74bb372746c0 req-be297866-cbfa-4f21-bc5c-014aff8c8750 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received unexpected event network-vif-plugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 for instance with vm_state building and task_state spawning.
Aug 16 11:25:41 user nova-compute[73067]: INFO nova.compute.manager [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Took 15.51 seconds to build instance.
Aug 16 11:25:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-079596b4-e99a-40cc-8bce-5f213ca521ee tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.608s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:25:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:25:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:25:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:25:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:25:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:25:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:25:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:26:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:26:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:26:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:26:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:26:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:21 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:26:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:26:23 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:26:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:26:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:26:23 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:26:23 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid fac55656-3b0c-4034-80ef-b90a0fb15bb2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updating instance_info_cache with network_info: [{"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:26:24 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:26:24 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=25.13603973388672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fac55656-3b0c-4034-80ef-b90a0fb15bb2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance afd6bec0-6e94-4778-829e-1304233f9ac9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:26:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 11:26:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:26:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:26:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:26:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:26:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:26:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:30 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid fac55656-3b0c-4034-80ef-b90a0fb15bb2 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid afd6bec0-6e94-4778-829e-1304233f9ac9 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "afd6bec0-6e94-4778-829e-1304233f9ac9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:26:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:26:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:26:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:26:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:26:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:26:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:26:51 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 11:26:51 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 11:26:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:26:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:26:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:26:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:26:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:26:57 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:26:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:27:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:27:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:27:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:27:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:27:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:27:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:27:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:27:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:27:14 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:27:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-737b8b95-26f1-4a0b-900e-c492f4f5758c req-0ff94111-2ecc-4c06-8e7e-3991f6ef9302 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received event network-changed-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:27:18 user nova-compute[73067]: DEBUG nova.compute.manager [req-737b8b95-26f1-4a0b-900e-c492f4f5758c req-0ff94111-2ecc-4c06-8e7e-3991f6ef9302 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Refreshing instance network info cache due to event network-changed-6ee9e1df-9a69-49e7-9e97-7b29c719cf11. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:27:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-737b8b95-26f1-4a0b-900e-c492f4f5758c req-0ff94111-2ecc-4c06-8e7e-3991f6ef9302 service nova] Acquiring lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:27:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-737b8b95-26f1-4a0b-900e-c492f4f5758c req-0ff94111-2ecc-4c06-8e7e-3991f6ef9302 service nova] Acquired lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:27:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-737b8b95-26f1-4a0b-900e-c492f4f5758c req-0ff94111-2ecc-4c06-8e7e-3991f6ef9302 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Refreshing network info cache for port 6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:27:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:27:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-737b8b95-26f1-4a0b-900e-c492f4f5758c req-0ff94111-2ecc-4c06-8e7e-3991f6ef9302 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Updated VIF entry in instance network info cache for port 6ee9e1df-9a69-49e7-9e97-7b29c719cf11. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:27:18 user nova-compute[73067]: DEBUG nova.network.neutron [req-737b8b95-26f1-4a0b-900e-c492f4f5758c req-0ff94111-2ecc-4c06-8e7e-3991f6ef9302 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Updating instance_info_cache with network_info: [{"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:27:18 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-737b8b95-26f1-4a0b-900e-c492f4f5758c req-0ff94111-2ecc-4c06-8e7e-3991f6ef9302 service nova] Releasing lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "afd6bec0-6e94-4778-829e-1304233f9ac9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:27:19 user nova-compute[73067]: INFO nova.compute.manager [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Terminating instance
Aug 16 11:27:19 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-a5522ae4-5fc5-4982-97c5-2d127dedf077 req-dd80963a-252b-45e0-b4e7-620057767a1f service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received event network-vif-unplugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5522ae4-5fc5-4982-97c5-2d127dedf077 req-dd80963a-252b-45e0-b4e7-620057767a1f service nova] Acquiring lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5522ae4-5fc5-4982-97c5-2d127dedf077 req-dd80963a-252b-45e0-b4e7-620057767a1f service nova] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-a5522ae4-5fc5-4982-97c5-2d127dedf077 req-dd80963a-252b-45e0-b4e7-620057767a1f service nova] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-a5522ae4-5fc5-4982-97c5-2d127dedf077 req-dd80963a-252b-45e0-b4e7-620057767a1f service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] No waiting events found dispatching network-vif-unplugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG nova.compute.manager [req-a5522ae4-5fc5-4982-97c5-2d127dedf077 req-dd80963a-252b-45e0-b4e7-620057767a1f service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received event network-vif-unplugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Instance destroyed successfully.
Aug 16 11:27:19 user nova-compute[73067]: DEBUG nova.objects.instance [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'resources' on Instance uuid afd6bec0-6e94-4778-829e-1304233f9ac9 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-620203371',display_name='tempest-TestVolumeBootPattern-server-620203371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-620203371',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfQnOxbelYGJIdPlv6s51762JxUXKbFHXhDmsQD3dwIgXIxov99vjfdOwt0Gqgwb91gXxZXKct7WLStT6hEFTIQPos1L2JcdVgxul8WQsxrQDfjiLlNJauw+kkR7FSPA==',key_name='tempest-TestVolumeBootPattern-747513915',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:25:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-4fkbjk61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:25:41Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=afd6bec0-6e94-4778-829e-1304233f9ac9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:57:fc,bridge_name='br-int',has_traffic_filtering=True,id=6ee9e1df-9a69-49e7-9e97-7b29c719cf11,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee9e1df-9a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG os_vif [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:57:fc,bridge_name='br-int',has_traffic_filtering=True,id=6ee9e1df-9a69-49e7-9e97-7b29c719cf11,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee9e1df-9a') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ee9e1df-9a, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:19 user nova-compute[73067]: INFO os_vif [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:57:fc,bridge_name='br-int',has_traffic_filtering=True,id=6ee9e1df-9a69-49e7-9e97-7b29c719cf11,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee9e1df-9a')
Aug 16 11:27:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCeorpaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:27:19 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:27:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a820b2a5-2d2c-40e0-9379-e3f21b7ec7f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aea6cb-6519-4433-9ed6-3dbb7d14cac8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:27:19 user nova-compute[73067]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb (non-flash)
Aug 16 11:27:19 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:27:19 user nova-compute[73067]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb (non-flash)
Aug 16 11:27:19 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35843b71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb'): ({'sdc'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Removing single pathed devices sdc {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2cda9a-6bd1-43ef-b918-517b08deee32]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:27:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0405bc2-b8ee-445b-9ef7-dd253f56799c]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flushing IO for device /dev/sdc {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.027s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e19a706-1642-4662-8db4-acdeba80cec5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-03aa2b30-3f81-4791-9502-7cb0c1a6e4de req-a0b9bdf3-a22e-4680-a272-488cfde96ca7 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received event network-changed-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG nova.compute.manager [req-03aa2b30-3f81-4791-9502-7cb0c1a6e4de req-a0b9bdf3-a22e-4680-a272-488cfde96ca7 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Refreshing instance network info cache due to event network-changed-6ee9e1df-9a69-49e7-9e97-7b29c719cf11. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-03aa2b30-3f81-4791-9502-7cb0c1a6e4de req-a0b9bdf3-a22e-4680-a272-488cfde96ca7 service nova] Acquiring lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-03aa2b30-3f81-4791-9502-7cb0c1a6e4de req-a0b9bdf3-a22e-4680-a272-488cfde96ca7 service nova] Acquired lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-03aa2b30-3f81-4791-9502-7cb0c1a6e4de req-a0b9bdf3-a22e-4680-a272-488cfde96ca7 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Refreshing network info cache for port 6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38e3e7c-ce7d-48a2-a4b9-a6a676b98fb8]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] SCSI volumes sdc have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23564323337633630', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9bc067ba', '/dev/disk/by-id/scsi-1SCST_BIO9bc067ba-5d237c6003a2736a') {{(pid=84181) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 11:27:20 user nova-compute[73067]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23564323337633630
Aug 16 11:27:20 user nova-compute[73067]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_9bc067ba
Aug 16 11:27:20 user nova-compute[73067]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO9bc067ba-5d237c6003a2736a
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd63096-5a87-40f2-9190-28ae01256f06]: (4, None) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2244ee-815d-41e1-bcd8-84380ac5588e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8c4293-ed64-4dc4-b453-61c00e3ccd15]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb, portal: 172.16.0.220,3260]
Aug 16 11:27:20 user nova-compute[73067]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb, portal: 172.16.0.220,3260] successful.
Aug 16 11:27:20 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07be5ce3-81e3-4a22-b81c-2103af8d43eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7efdcb-9b15-4fc6-b760-6297b7db0700]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== disconnect_volume: return (315ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:27:20 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Deleting instance files /opt/stack/data/nova/instances/afd6bec0-6e94-4778-829e-1304233f9ac9_del
Aug 16 11:27:20 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Deletion of /opt/stack/data/nova/instances/afd6bec0-6e94-4778-829e-1304233f9ac9_del complete
Aug 16 11:27:20 user nova-compute[73067]: INFO nova.compute.manager [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-03aa2b30-3f81-4791-9502-7cb0c1a6e4de req-a0b9bdf3-a22e-4680-a272-488cfde96ca7 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Updated VIF entry in instance network info cache for port 6ee9e1df-9a69-49e7-9e97-7b29c719cf11. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG nova.network.neutron [req-03aa2b30-3f81-4791-9502-7cb0c1a6e4de req-a0b9bdf3-a22e-4680-a272-488cfde96ca7 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Updating instance_info_cache with network_info: [{"id": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "address": "fa:16:3e:4d:57:fc", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee9e1df-9a", "ovs_interfaceid": "6ee9e1df-9a69-49e7-9e97-7b29c719cf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-03aa2b30-3f81-4791-9502-7cb0c1a6e4de req-a0b9bdf3-a22e-4680-a272-488cfde96ca7 service nova] Releasing lock "refresh_cache-afd6bec0-6e94-4778-829e-1304233f9ac9" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:27:20 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:27:20 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Took 0.60 seconds to deallocate network for instance.
Aug 16 11:27:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-dd91a514-6f50-4e54-a58f-73d913701790 req-5b867e45-db05-4e50-bd38-c84907952c66 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received event network-vif-plugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dd91a514-6f50-4e54-a58f-73d913701790 req-5b867e45-db05-4e50-bd38-c84907952c66 service nova] Acquiring lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dd91a514-6f50-4e54-a58f-73d913701790 req-5b867e45-db05-4e50-bd38-c84907952c66 service nova] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-dd91a514-6f50-4e54-a58f-73d913701790 req-5b867e45-db05-4e50-bd38-c84907952c66 service nova] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-dd91a514-6f50-4e54-a58f-73d913701790 req-5b867e45-db05-4e50-bd38-c84907952c66 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] No waiting events found dispatching network-vif-plugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:27:21 user nova-compute[73067]: WARNING nova.compute.manager [req-dd91a514-6f50-4e54-a58f-73d913701790 req-5b867e45-db05-4e50-bd38-c84907952c66 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received unexpected event network-vif-plugged-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 for instance with vm_state active and task_state deleting.
Aug 16 11:27:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-dd91a514-6f50-4e54-a58f-73d913701790 req-5b867e45-db05-4e50-bd38-c84907952c66 service nova] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Received event network-vif-deleted-6ee9e1df-9a69-49e7-9e97-7b29c719cf11 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:27:21 user nova-compute[73067]: INFO nova.compute.manager [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Took 0.78 seconds to detach 1 volumes for instance.
Aug 16 11:27:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:27:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:27:22 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Deleted allocations for instance afd6bec0-6e94-4778-829e-1304233f9ac9
Aug 16 11:27:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-4070df70-9ae7-4d84-8647-0b1f44760fb1 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "afd6bec0-6e94-4778-829e-1304233f9ac9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.038s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:27:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:27:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73067) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 11:27:24 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:27:24 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:27:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=25.13515853881836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance fac55656-3b0c-4034-80ef-b90a0fb15bb2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:27:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:27:25 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:27:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:27:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:27:30 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:27:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:27:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:27:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:27:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:27:34 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692185239.8733535, afd6bec0-6e94-4778-829e-1304233f9ac9 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:27:34 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] VM Stopped (Lifecycle Event)
Aug 16 11:27:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-4532f32e-17c9-4ee0-8577-820a86cae42c None None] [instance: afd6bec0-6e94-4778-829e-1304233f9ac9] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:27:35 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:27:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:27:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:27:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:27:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:27:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:27:45 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:27:50 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:27:55 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:28:00 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:28:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:28:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:28:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:28:05 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:28:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:28:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:28:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:28:10 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:28:15 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:16 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:28:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:28:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-5c812017-46f9-4361-b812-1caace1ee398 req-98393138-fc87-4d89-86dd-8e53ef942f4f service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received event network-changed-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG nova.compute.manager [req-5c812017-46f9-4361-b812-1caace1ee398 req-98393138-fc87-4d89-86dd-8e53ef942f4f service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Refreshing instance network info cache due to event network-changed-f65b2b98-1d07-4896-87fe-e02c8cd661ac. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5c812017-46f9-4361-b812-1caace1ee398 req-98393138-fc87-4d89-86dd-8e53ef942f4f service nova] Acquiring lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5c812017-46f9-4361-b812-1caace1ee398 req-98393138-fc87-4d89-86dd-8e53ef942f4f service nova] Acquired lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG nova.network.neutron [req-5c812017-46f9-4361-b812-1caace1ee398 req-98393138-fc87-4d89-86dd-8e53ef942f4f service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Refreshing network info cache for port f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:28:21 user nova-compute[73067]: INFO nova.compute.manager [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Terminating instance
Aug 16 11:28:21 user nova-compute[73067]: DEBUG nova.compute.manager [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-2d7aa86f-957d-48da-8ef5-f59d228abdfc req-d553810b-2dcb-469e-9467-c75ea8893655 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received event network-vif-unplugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2d7aa86f-957d-48da-8ef5-f59d228abdfc req-d553810b-2dcb-469e-9467-c75ea8893655 service nova] Acquiring lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2d7aa86f-957d-48da-8ef5-f59d228abdfc req-d553810b-2dcb-469e-9467-c75ea8893655 service nova] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-2d7aa86f-957d-48da-8ef5-f59d228abdfc req-d553810b-2dcb-469e-9467-c75ea8893655 service nova] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-2d7aa86f-957d-48da-8ef5-f59d228abdfc req-d553810b-2dcb-469e-9467-c75ea8893655 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] No waiting events found dispatching network-vif-unplugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG nova.compute.manager [req-2d7aa86f-957d-48da-8ef5-f59d228abdfc req-d553810b-2dcb-469e-9467-c75ea8893655 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received event network-vif-unplugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Instance destroyed successfully.
Aug 16 11:28:22 user nova-compute[73067]: DEBUG nova.objects.instance [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lazy-loading 'resources' on Instance uuid fac55656-3b0c-4034-80ef-b90a0fb15bb2 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-820958866',display_name='tempest-TestVolumeBootPattern-server-820958866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-820958866',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfQnOxbelYGJIdPlv6s51762JxUXKbFHXhDmsQD3dwIgXIxov99vjfdOwt0Gqgwb91gXxZXKct7WLStT6hEFTIQPos1L2JcdVgxul8WQsxrQDfjiLlNJauw+kkR7FSPA==',key_name='tempest-TestVolumeBootPattern-747513915',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:23:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a30d2208752496280dd6347a3fcd87d',ramdisk_id='',reservation_id='r-cfbkz2iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996305180',owner_user_name='tempest-TestVolumeBootPattern-1996305180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:23:34Z,user_data=None,user_id='0bda8cdb53a94455a9a666ad43d60434',uuid=fac55656-3b0c-4034-80ef-b90a0fb15bb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converting VIF {"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f65b2b98-1d07-4896-87fe-e02c8cd661ac,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf65b2b98-1d') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_vif [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f65b2b98-1d07-4896-87fe-e02c8cd661ac,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf65b2b98-1d') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf65b2b98-1d, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:28:22 user nova-compute[73067]: INFO os_vif [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f65b2b98-1d07-4896-87fe-e02c8cd661ac,network=Network(517d1fec-df44-4fcf-a66b-14049d2413c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf65b2b98-1d')
Aug 16 11:28:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcJCpTgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:28:22 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4d61f7-afeb-46aa-a159-d89688cc1fdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[465472b5-8776-48c7-9b07-b2a94928bca4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:28:22 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 (non-flash)
Aug 16 11:28:22 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3564368430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31a0f2e-c66d-4443-9e09-067c65015ddb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a943ac-ea23-4a8a-bd33-6166a0ba5a21]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5048223c-d04f-420c-b8c3-4b0dbc9c665d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[507cb74d-43ae-4fcb-a1a0-c6786649efae]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3a8e9186', '/dev/disk/by-id/scsi-1SCST_BIO3a8e9186-1832f66ad6e47b71', '/dev/disk/by-id/scsi-23138333266363661') {{(pid=84181) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee44391-5bbe-4318-af81-98537480a815]: (4, None) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d832762c-c81c-4912-971d-c1acb7d717cb]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a025b570-5cff-47ca-a36d-5c6e95705cdd]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260]
Aug 16 11:28:22 user nova-compute[73067]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075, portal: 172.16.0.220,3260] successful.
Aug 16 11:28:22 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b06f01-f112-4f19-9b02-edfdb02c1075 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[255c9b95-8d4a-41fb-8f2f-43b2d76f9d4a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] <== disconnect_volume: return (278ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:28:22 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:28:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Deleting instance files /opt/stack/data/nova/instances/fac55656-3b0c-4034-80ef-b90a0fb15bb2_del
Aug 16 11:28:22 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Deletion of /opt/stack/data/nova/instances/fac55656-3b0c-4034-80ef-b90a0fb15bb2_del complete
Aug 16 11:28:23 user nova-compute[73067]: INFO nova.compute.manager [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 16 11:28:23 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:28:23 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:28:23 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:28:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:28:23 user nova-compute[73067]: DEBUG nova.network.neutron [req-5c812017-46f9-4361-b812-1caace1ee398 req-98393138-fc87-4d89-86dd-8e53ef942f4f service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updated VIF entry in instance network info cache for port f65b2b98-1d07-4896-87fe-e02c8cd661ac. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:28:23 user nova-compute[73067]: DEBUG nova.network.neutron [req-5c812017-46f9-4361-b812-1caace1ee398 req-98393138-fc87-4d89-86dd-8e53ef942f4f service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updating instance_info_cache with network_info: [{"id": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "address": "fa:16:3e:bb:c8:b1", "network": {"id": "517d1fec-df44-4fcf-a66b-14049d2413c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394573256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a30d2208752496280dd6347a3fcd87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf65b2b98-1d", "ovs_interfaceid": "f65b2b98-1d07-4896-87fe-e02c8cd661ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:28:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5c812017-46f9-4361-b812-1caace1ee398 req-98393138-fc87-4d89-86dd-8e53ef942f4f service nova] Releasing lock "refresh_cache-fac55656-3b0c-4034-80ef-b90a0fb15bb2" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:28:23 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:28:23 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Took 0.44 seconds to deallocate network for instance.
Aug 16 11:28:23 user nova-compute[73067]: DEBUG nova.compute.manager [req-b0c50e6c-c62a-4dbe-b9fd-9b66604d1604 req-2f8987a1-ef3f-48d1-802c-822ea30a0753 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received event network-vif-deleted-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:28:24 user nova-compute[73067]: INFO nova.compute.manager [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 11:28:24 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d69c8ab-ca34-4a48-8605-bbaf039d18cc req-966f89fd-7820-4afc-a657-ccae79e8a811 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received event network-vif-plugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d69c8ab-ca34-4a48-8605-bbaf039d18cc req-966f89fd-7820-4afc-a657-ccae79e8a811 service nova] Acquiring lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d69c8ab-ca34-4a48-8605-bbaf039d18cc req-966f89fd-7820-4afc-a657-ccae79e8a811 service nova] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-8d69c8ab-ca34-4a48-8605-bbaf039d18cc req-966f89fd-7820-4afc-a657-ccae79e8a811 service nova] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:28:24 user nova-compute[73067]: DEBUG nova.compute.manager [req-8d69c8ab-ca34-4a48-8605-bbaf039d18cc req-966f89fd-7820-4afc-a657-ccae79e8a811 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] No waiting events found dispatching network-vif-plugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:28:24 user nova-compute[73067]: WARNING nova.compute.manager [req-8d69c8ab-ca34-4a48-8605-bbaf039d18cc req-966f89fd-7820-4afc-a657-ccae79e8a811 service nova] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Received unexpected event network-vif-plugged-f65b2b98-1d07-4896-87fe-e02c8cd661ac for instance with vm_state active and task_state deleting.
Aug 16 11:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:28:24 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:28:24 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:28:24 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Deleted allocations for instance fac55656-3b0c-4034-80ef-b90a0fb15bb2
Aug 16 11:28:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-60887816-1bdc-4eb4-a674-898f1ff81fe8 tempest-TestVolumeBootPattern-1996305180 tempest-TestVolumeBootPattern-1996305180-project-member] Lock "fac55656-3b0c-4034-80ef-b90a0fb15bb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.622s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:28:25 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:28:25 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:28:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.134246826171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:28:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:28:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:27 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:28:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:28:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:28:27 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:28:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:28:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:28:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:28:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:28:34 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:28:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:28:37 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692185302.6227493, fac55656-3b0c-4034-80ef-b90a0fb15bb2 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:28:37 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] VM Stopped (Lifecycle Event)
Aug 16 11:28:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-2b69e6de-f6ac-4b1e-bc8a-56cb6f3007c9 None None] [instance: fac55656-3b0c-4034-80ef-b90a0fb15bb2] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:28:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:28:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:28:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:28:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:28:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:28:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:28:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:29:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:15 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:29:16 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:29:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:29:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:29:25 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:29:25 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:29:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=25.133220672607422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:29:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:29:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:29:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:29:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:29:28 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:29:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:34 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:29:34 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:29:34 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:29:34 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:40 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Starting instance... {{(pid=73067) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73067) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 11:29:44 user nova-compute[73067]: INFO nova.compute.claims [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Claim successful on node user
Aug 16 11:29:44 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Start building networks asynchronously for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Allocating IP information in the background. {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 11:29:44 user nova-compute[73067]: DEBUG nova.network.neutron [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] allocate_for_instance() {{(pid=73067) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 11:29:44 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 11:29:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Start building block device mappings for instance. {{(pid=73067) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG nova.policy [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a21b8af065024013bed5da238eed6d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261b57c7ca8648d3ac70fcf0c6f9b710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73067) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Start spawning the instance on the hypervisor. {{(pid=73067) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Creating instance directory {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 11:29:45 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Creating image(s)
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "/opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "/opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "/opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.179s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk 1073741824 {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832,backing_fmt=raw /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk 1073741824" returned: 0 in 0.049s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "7bfda5d2bc849eaa1b1d4e68bcac2384cc927832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG nova.network.neutron [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Successfully created port: 199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bfda5d2bc849eaa1b1d4e68bcac2384cc927832 --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk. size=1073741824 {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG nova.virt.disk.api [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Cannot resize image /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk to a smaller size. {{(pid=73067) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'migration_context' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Created local disks {{(pid=73067) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Ensure instance console log exists: /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/console.log {{(pid=73067) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:29:45 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.network.neutron [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Successfully updated port: 199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquired lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.network.neutron [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Building network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-334f280c-2c43-4a1a-90c8-60d25776a108 req-a738cb9e-2932-4b7a-a785-bf2b686f6eb0 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received event network-changed-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.compute.manager [req-334f280c-2c43-4a1a-90c8-60d25776a108 req-a738cb9e-2932-4b7a-a785-bf2b686f6eb0 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Refreshing instance network info cache due to event network-changed-199d1436-4a6e-4025-a700-a7670dad2be8. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-334f280c-2c43-4a1a-90c8-60d25776a108 req-a738cb9e-2932-4b7a-a785-bf2b686f6eb0 service nova] Acquiring lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.network.neutron [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Instance cache missing network info. {{(pid=73067) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.network.neutron [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Releasing lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Instance network_info: |[{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73067) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-334f280c-2c43-4a1a-90c8-60d25776a108 req-a738cb9e-2932-4b7a-a785-bf2b686f6eb0 service nova] Acquired lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.network.neutron [req-334f280c-2c43-4a1a-90c8-60d25776a108 req-a738cb9e-2932-4b7a-a785-bf2b686f6eb0 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Refreshing network info cache for port 199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Start _get_guest_xml network_info=[{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 11:29:46 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:29:46 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] CPU controller missing on host. {{(pid=73067) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.host [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] CPU controller found on host. {{(pid=73067) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73067) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T10:25:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T10:25:50Z,direct_url=<?>,disk_format='qcow2',id=8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a83b2965d41e4fa79e71b26f13150553',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T10:25:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Flavor limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Image limits 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Flavor pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Image pref 0:0:0 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Got 1 possible topologies {{(pid=73067) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.hardware [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73067) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-911559297',display_name='tempest-SnapshotDataIntegrityTests-server-911559297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-911559297',id=52,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/FyAPxXC9SreaP8WZdGdKlCvnIwf6JF0BUs7ZOPvZ3RJigYwlykf6sxafNCmCMMCQMNYpH6XseaZqOIVPRWLFRphgNIAtDUNvUAmvqtWiZ5feBKk5Lg6DqZAfMp6ZAlA==',key_name='tempest-keypair-736801926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='261b57c7ca8648d3ac70fcf0c6f9b710',ramdisk_id='',reservation_id='r-iay7rere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1932441878',owner_user_name='tempest-SnapshotDataIntegrityTests-1932441878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:29:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a21b8af065024013bed5da238eed6d8a',uuid=6521c88d-b213-4949-8a86-7c3d6e2d09b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73067) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Converting VIF {"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=199d1436-4a6e-4025-a700-a7670dad2be8,network=Network(7006659b-ccfb-4f77-ad58-74f7af05ec67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap199d1436-4a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.objects.instance [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'pci_devices' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 11:29:46 user nova-compute[73067]:   <uuid>6521c88d-b213-4949-8a86-7c3d6e2d09b1</uuid>
Aug 16 11:29:46 user nova-compute[73067]:   <name>instance-00000034</name>
Aug 16 11:29:46 user nova-compute[73067]:   <memory>524288</memory>
Aug 16 11:29:46 user nova-compute[73067]:   <vcpu>1</vcpu>
Aug 16 11:29:46 user nova-compute[73067]:   <metadata>
Aug 16 11:29:46 user nova-compute[73067]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 11:29:46 user nova-compute[73067]:       <nova:package version="0.0.0"/>
Aug 16 11:29:46 user nova-compute[73067]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-911559297</nova:name>
Aug 16 11:29:46 user nova-compute[73067]:       <nova:creationTime>2023-08-16 11:29:46</nova:creationTime>
Aug 16 11:29:46 user nova-compute[73067]:       <nova:flavor name="m1.tiny">
Aug 16 11:29:46 user nova-compute[73067]:         <nova:memory>512</nova:memory>
Aug 16 11:29:46 user nova-compute[73067]:         <nova:disk>1</nova:disk>
Aug 16 11:29:46 user nova-compute[73067]:         <nova:swap>0</nova:swap>
Aug 16 11:29:46 user nova-compute[73067]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 11:29:46 user nova-compute[73067]:         <nova:vcpus>1</nova:vcpus>
Aug 16 11:29:46 user nova-compute[73067]:       </nova:flavor>
Aug 16 11:29:46 user nova-compute[73067]:       <nova:owner>
Aug 16 11:29:46 user nova-compute[73067]:         <nova:user uuid="a21b8af065024013bed5da238eed6d8a">tempest-SnapshotDataIntegrityTests-1932441878-project-member</nova:user>
Aug 16 11:29:46 user nova-compute[73067]:         <nova:project uuid="261b57c7ca8648d3ac70fcf0c6f9b710">tempest-SnapshotDataIntegrityTests-1932441878</nova:project>
Aug 16 11:29:46 user nova-compute[73067]:       </nova:owner>
Aug 16 11:29:46 user nova-compute[73067]:       <nova:root type="image" uuid="8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58"/>
Aug 16 11:29:46 user nova-compute[73067]:       <nova:ports>
Aug 16 11:29:46 user nova-compute[73067]:         <nova:port uuid="199d1436-4a6e-4025-a700-a7670dad2be8">
Aug 16 11:29:46 user nova-compute[73067]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 11:29:46 user nova-compute[73067]:         </nova:port>
Aug 16 11:29:46 user nova-compute[73067]:       </nova:ports>
Aug 16 11:29:46 user nova-compute[73067]:     </nova:instance>
Aug 16 11:29:46 user nova-compute[73067]:   </metadata>
Aug 16 11:29:46 user nova-compute[73067]:   <sysinfo type="smbios">
Aug 16 11:29:46 user nova-compute[73067]:     <system>
Aug 16 11:29:46 user nova-compute[73067]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 11:29:46 user nova-compute[73067]:       <entry name="product">OpenStack Nova</entry>
Aug 16 11:29:46 user nova-compute[73067]:       <entry name="version">0.0.0</entry>
Aug 16 11:29:46 user nova-compute[73067]:       <entry name="serial">6521c88d-b213-4949-8a86-7c3d6e2d09b1</entry>
Aug 16 11:29:46 user nova-compute[73067]:       <entry name="uuid">6521c88d-b213-4949-8a86-7c3d6e2d09b1</entry>
Aug 16 11:29:46 user nova-compute[73067]:       <entry name="family">Virtual Machine</entry>
Aug 16 11:29:46 user nova-compute[73067]:     </system>
Aug 16 11:29:46 user nova-compute[73067]:   </sysinfo>
Aug 16 11:29:46 user nova-compute[73067]:   <os>
Aug 16 11:29:46 user nova-compute[73067]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 11:29:46 user nova-compute[73067]:     <boot dev="hd"/>
Aug 16 11:29:46 user nova-compute[73067]:     <smbios mode="sysinfo"/>
Aug 16 11:29:46 user nova-compute[73067]:   </os>
Aug 16 11:29:46 user nova-compute[73067]:   <features>
Aug 16 11:29:46 user nova-compute[73067]:     <acpi/>
Aug 16 11:29:46 user nova-compute[73067]:     <apic/>
Aug 16 11:29:46 user nova-compute[73067]:     <vmcoreinfo/>
Aug 16 11:29:46 user nova-compute[73067]:   </features>
Aug 16 11:29:46 user nova-compute[73067]:   <clock offset="utc">
Aug 16 11:29:46 user nova-compute[73067]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 11:29:46 user nova-compute[73067]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 11:29:46 user nova-compute[73067]:     <timer name="hpet" present="no"/>
Aug 16 11:29:46 user nova-compute[73067]:   </clock>
Aug 16 11:29:46 user nova-compute[73067]:   <cpu mode="custom" match="exact">
Aug 16 11:29:46 user nova-compute[73067]:     <model>Nehalem</model>
Aug 16 11:29:46 user nova-compute[73067]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 11:29:46 user nova-compute[73067]:   </cpu>
Aug 16 11:29:46 user nova-compute[73067]:   <devices>
Aug 16 11:29:46 user nova-compute[73067]:     <disk type="file" device="disk">
Aug 16 11:29:46 user nova-compute[73067]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 11:29:46 user nova-compute[73067]:       <source file="/opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk"/>
Aug 16 11:29:46 user nova-compute[73067]:       <target dev="vda" bus="virtio"/>
Aug 16 11:29:46 user nova-compute[73067]:     </disk>
Aug 16 11:29:46 user nova-compute[73067]:     <interface type="ethernet">
Aug 16 11:29:46 user nova-compute[73067]:       <mac address="fa:16:3e:41:7d:1a"/>
Aug 16 11:29:46 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:29:46 user nova-compute[73067]:       <mtu size="1442"/>
Aug 16 11:29:46 user nova-compute[73067]:       <target dev="tap199d1436-4a"/>
Aug 16 11:29:46 user nova-compute[73067]:     </interface>
Aug 16 11:29:46 user nova-compute[73067]:     <serial type="pty">
Aug 16 11:29:46 user nova-compute[73067]:       <log file="/opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/console.log" append="off"/>
Aug 16 11:29:46 user nova-compute[73067]:     </serial>
Aug 16 11:29:46 user nova-compute[73067]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 11:29:46 user nova-compute[73067]:     <video>
Aug 16 11:29:46 user nova-compute[73067]:       <model type="virtio"/>
Aug 16 11:29:46 user nova-compute[73067]:     </video>
Aug 16 11:29:46 user nova-compute[73067]:     <rng model="virtio">
Aug 16 11:29:46 user nova-compute[73067]:       <backend model="random">/dev/urandom</backend>
Aug 16 11:29:46 user nova-compute[73067]:     </rng>
Aug 16 11:29:46 user nova-compute[73067]:     <controller type="usb" index="0" model="none"/>
Aug 16 11:29:46 user nova-compute[73067]:     <memballoon model="virtio">
Aug 16 11:29:46 user nova-compute[73067]:       <stats period="10"/>
Aug 16 11:29:46 user nova-compute[73067]:     </memballoon>
Aug 16 11:29:46 user nova-compute[73067]:   </devices>
Aug 16 11:29:46 user nova-compute[73067]: </domain>
Aug 16 11:29:46 user nova-compute[73067]:  {{(pid=73067) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-911559297',display_name='tempest-SnapshotDataIntegrityTests-server-911559297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-911559297',id=52,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/FyAPxXC9SreaP8WZdGdKlCvnIwf6JF0BUs7ZOPvZ3RJigYwlykf6sxafNCmCMMCQMNYpH6XseaZqOIVPRWLFRphgNIAtDUNvUAmvqtWiZ5feBKk5Lg6DqZAfMp6ZAlA==',key_name='tempest-keypair-736801926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='261b57c7ca8648d3ac70fcf0c6f9b710',ramdisk_id='',reservation_id='r-iay7rere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1932441878',owner_user_name='tempest-SnapshotDataIntegrityTests-1932441878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T11:29:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a21b8af065024013bed5da238eed6d8a',uuid=6521c88d-b213-4949-8a86-7c3d6e2d09b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Converting VIF {"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=199d1436-4a6e-4025-a700-a7670dad2be8,network=Network(7006659b-ccfb-4f77-ad58-74f7af05ec67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap199d1436-4a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG os_vif [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=199d1436-4a6e-4025-a700-a7670dad2be8,network=Network(7006659b-ccfb-4f77-ad58-74f7af05ec67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap199d1436-4a') {{(pid=73067) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap199d1436-4a, may_exist=True, interface_attrs={}) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap199d1436-4a, col_values=(('external_ids', {'iface-id': '199d1436-4a6e-4025-a700-a7670dad2be8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:7d:1a', 'vm-uuid': '6521c88d-b213-4949-8a86-7c3d6e2d09b1'}),), if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:29:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:46 user nova-compute[73067]: INFO os_vif [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=199d1436-4a6e-4025-a700-a7670dad2be8,network=Network(7006659b-ccfb-4f77-ad58-74f7af05ec67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap199d1436-4a')
Aug 16 11:29:47 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:29:47 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No VIF found with MAC fa:16:3e:41:7d:1a, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:29:47 user nova-compute[73067]: DEBUG nova.network.neutron [req-334f280c-2c43-4a1a-90c8-60d25776a108 req-a738cb9e-2932-4b7a-a785-bf2b686f6eb0 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updated VIF entry in instance network info cache for port 199d1436-4a6e-4025-a700-a7670dad2be8. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:29:47 user nova-compute[73067]: DEBUG nova.network.neutron [req-334f280c-2c43-4a1a-90c8-60d25776a108 req-a738cb9e-2932-4b7a-a785-bf2b686f6eb0 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:29:47 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-334f280c-2c43-4a1a-90c8-60d25776a108 req-a738cb9e-2932-4b7a-a785-bf2b686f6eb0 service nova] Releasing lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:29:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-fa6c9a9d-6122-4470-89ff-75b29997ed23 req-e15e0104-80d8-4da5-bbf3-cd7841cf1e38 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received event network-vif-plugged-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:29:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fa6c9a9d-6122-4470-89ff-75b29997ed23 req-e15e0104-80d8-4da5-bbf3-cd7841cf1e38 service nova] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:29:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fa6c9a9d-6122-4470-89ff-75b29997ed23 req-e15e0104-80d8-4da5-bbf3-cd7841cf1e38 service nova] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:29:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-fa6c9a9d-6122-4470-89ff-75b29997ed23 req-e15e0104-80d8-4da5-bbf3-cd7841cf1e38 service nova] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:29:48 user nova-compute[73067]: DEBUG nova.compute.manager [req-fa6c9a9d-6122-4470-89ff-75b29997ed23 req-e15e0104-80d8-4da5-bbf3-cd7841cf1e38 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] No waiting events found dispatching network-vif-plugged-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:29:48 user nova-compute[73067]: WARNING nova.compute.manager [req-fa6c9a9d-6122-4470-89ff-75b29997ed23 req-e15e0104-80d8-4da5-bbf3-cd7841cf1e38 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received unexpected event network-vif-plugged-199d1436-4a6e-4025-a700-a7670dad2be8 for instance with vm_state building and task_state spawning.
Aug 16 11:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692185390.4208436, 6521c88d-b213-4949-8a86-7c3d6e2d09b1 => Resumed> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:29:50 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] VM Resumed (Lifecycle Event)
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Instance event wait completed in 0 seconds for  {{(pid=73067) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Guest created on hypervisor {{(pid=73067) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 11:29:50 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Instance spawned successfully.
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Found default for hw_cdrom_bus of ide {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Found default for hw_disk_bus of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Found default for hw_input_bus of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Found default for hw_pointer_model of None {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Found default for hw_video_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Found default for hw_vif_model of virtio {{(pid=73067) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 11:29:50 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.virt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Emitting event <LifecycleEvent: 1692185390.4221876, 6521c88d-b213-4949-8a86-7c3d6e2d09b1 => Started> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:29:50 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] VM Started (Lifecycle Event)
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73067) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 11:29:50 user nova-compute[73067]: INFO nova.compute.manager [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 11:29:50 user nova-compute[73067]: INFO nova.compute.manager [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Took 5.50 seconds to spawn the instance on the hypervisor.
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.compute.manager [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:29:50 user nova-compute[73067]: INFO nova.compute.manager [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Took 5.98 seconds to build instance.
Aug 16 11:29:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-cc5e4e53-2f02-45b3-83a2-c30a9f872301 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.107s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-ae0a3b72-d268-46e2-8745-9394259de3e6 req-6f46d855-10fe-42fd-abf3-839539238746 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received event network-vif-plugged-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ae0a3b72-d268-46e2-8745-9394259de3e6 req-6f46d855-10fe-42fd-abf3-839539238746 service nova] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ae0a3b72-d268-46e2-8745-9394259de3e6 req-6f46d855-10fe-42fd-abf3-839539238746 service nova] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-ae0a3b72-d268-46e2-8745-9394259de3e6 req-6f46d855-10fe-42fd-abf3-839539238746 service nova] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:29:50 user nova-compute[73067]: DEBUG nova.compute.manager [req-ae0a3b72-d268-46e2-8745-9394259de3e6 req-6f46d855-10fe-42fd-abf3-839539238746 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] No waiting events found dispatching network-vif-plugged-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:29:50 user nova-compute[73067]: WARNING nova.compute.manager [req-ae0a3b72-d268-46e2-8745-9394259de3e6 req-6f46d855-10fe-42fd-abf3-839539238746 service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received unexpected event network-vif-plugged-199d1436-4a6e-4025-a700-a7670dad2be8 for instance with vm_state active and task_state None.
Aug 16 11:29:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:29:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:16 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:30:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:17 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:30:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:21 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:30:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:30:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:30:25 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:30:25 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:30:25 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:30:25 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:30:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.102439880371094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:30:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:30:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:30:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:30:26 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:30:26 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:30:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:30:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:30:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:30:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:30:31 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:30:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:30:31 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:30:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:30:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:30:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:30:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:30:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:30:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:30:34 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:30:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:30:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:30:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:30:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:30:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:30:46 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:30:51 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:30:56 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:31:01 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:31:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:31:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:31:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:31:06 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:31:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:31:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:31:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:31:11 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:16 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:16 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:21 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:21 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:31:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:25 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:26 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:31:26 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:31:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.10190200805664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:31:26 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:31:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:31:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:31:27 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:31:27 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:31:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:31:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:31:31 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:31:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:31:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:31:32 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:31:32 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:31:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:31:32 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:31:34 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:35 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-e1e756d7-eedc-47d3-ba34-3c2802f0a420 req-5cbdbf2f-4a92-44c9-9885-a8f83ffbe44a service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received event network-changed-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:31:35 user nova-compute[73067]: DEBUG nova.compute.manager [req-e1e756d7-eedc-47d3-ba34-3c2802f0a420 req-5cbdbf2f-4a92-44c9-9885-a8f83ffbe44a service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Refreshing instance network info cache due to event network-changed-199d1436-4a6e-4025-a700-a7670dad2be8. {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 11:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e1e756d7-eedc-47d3-ba34-3c2802f0a420 req-5cbdbf2f-4a92-44c9-9885-a8f83ffbe44a service nova] Acquiring lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e1e756d7-eedc-47d3-ba34-3c2802f0a420 req-5cbdbf2f-4a92-44c9-9885-a8f83ffbe44a service nova] Acquired lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:31:35 user nova-compute[73067]: DEBUG nova.network.neutron [req-e1e756d7-eedc-47d3-ba34-3c2802f0a420 req-5cbdbf2f-4a92-44c9-9885-a8f83ffbe44a service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Refreshing network info cache for port 199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 11:31:35 user nova-compute[73067]: DEBUG nova.network.neutron [req-e1e756d7-eedc-47d3-ba34-3c2802f0a420 req-5cbdbf2f-4a92-44c9-9885-a8f83ffbe44a service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updated VIF entry in instance network info cache for port 199d1436-4a6e-4025-a700-a7670dad2be8. {{(pid=73067) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 11:31:35 user nova-compute[73067]: DEBUG nova.network.neutron [req-e1e756d7-eedc-47d3-ba34-3c2802f0a420 req-5cbdbf2f-4a92-44c9-9885-a8f83ffbe44a service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:31:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-e1e756d7-eedc-47d3-ba34-3c2802f0a420 req-5cbdbf2f-4a92-44c9-9885-a8f83ffbe44a service nova] Releasing lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:31:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:36 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:37 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:37 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:31:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:31:40 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:31:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:31:41 user nova-compute[73067]: INFO nova.compute.manager [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attaching volume f6b44d48-7558-4f7d-adf9-8a638574bf13 to /dev/vdb
Aug 16 11:31:41 user nova-compute[73067]: DEBUG os_brick.utils [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be85bfb-b3a1-4322-93ae-aad050a5e5b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a5720a-2d55-4ade-bcef-f5b0c56b2583]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[121de7ef-5e36-442b-9be8-b1d69d7b280a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b579cbc-c055-489a-aed8-86c89960f5b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:31:41 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:31:41 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[355070d8-d2d6-4d28-bc2a-0dce80ff58ec]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG os_brick.utils [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating existing volume attachment record: 4a487776-7c5c-49ea-a9f3-1565dba551a3 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:31:41 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqdjnlpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:31:50 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:31:50 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:31:50 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[960b1410-e045-49ec-90cf-e4cefe0015c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:31:50 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5b24f8-8f13-4e94-afaf-13d3f1658642]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13] added
Aug 16 11:31:50 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c99874-eee8-4469-80f3-1cb72950d568]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e0d7f2-453c-437e-83c8-c36327a0b3da]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqdjnlpC {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqdjnlpC" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a312888d-8dfa-4b95-8f01-d691b2dca814]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wqdjnlpC'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51555e4-0c66-44b3-94de-8dbd340cc9b0]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2b2fe2-6474-41e5-8347-e1e09aa11d9d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:31:50 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:31:50 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:31:50 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 11:31:50 user nova-compute[73067]: 
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[4103d209-843e-4a09-b3e2-ce41f353e590]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13, portal: 172.16.0.220,3260]
Aug 16 11:31:50 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13, portal: 172.16.0.220,3260] successful.
Aug 16 11:31:50 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a5813-ddd9-4d14-bb76-fd1daebec142]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7875c621-9507-4fb7-a13e-5bddafea9382]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 (non-flash)
Aug 16 11:31:50 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 (non-flash)
Aug 16 11:31:50 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6071f3-025b-4fdf-8374-fd035d7ebf3e]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:31:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqdjnlpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:31:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:31:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23238643438356139', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:31:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238643438356139', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:31:51 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:31:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 11:31:51 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:31:51 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:31:51 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:31:51 user nova-compute[73067]:   <serial>f6b44d48-7558-4f7d-adf9-8a638574bf13</serial>
Aug 16 11:31:51 user nova-compute[73067]: </disk>
Aug 16 11:31:51 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 11:31:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:31:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:31:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:31:52 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No VIF found with MAC fa:16:3e:41:7d:1a, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:31:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f5a701f4-97f7-4a7b-ba01-b60f5fb1f1ec tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.468s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:31:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:31:59 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:31:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 11:31:59 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 11:32:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:32:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:32:19 user nova-compute[73067]: INFO nova.compute.manager [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Detaching volume f6b44d48-7558-4f7d-adf9-8a638574bf13
Aug 16 11:32:19 user nova-compute[73067]: INFO nova.virt.block_device [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attempting to driver detach volume f6b44d48-7558-4f7d-adf9-8a638574bf13 from mountpoint /dev/vdb
Aug 16 11:32:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Attempting to detach device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 11:32:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:32:19 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:32:19 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:32:19 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:32:19 user nova-compute[73067]:   <serial>f6b44d48-7558-4f7d-adf9-8a638574bf13</serial>
Aug 16 11:32:19 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:32:19 user nova-compute[73067]: </disk>
Aug 16 11:32:19 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:32:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Successfully detached device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the persistent domain config.
Aug 16 11:32:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 11:32:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:32:19 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:32:19 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:32:19 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:32:19 user nova-compute[73067]:   <serial>f6b44d48-7558-4f7d-adf9-8a638574bf13</serial>
Aug 16 11:32:19 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:32:19 user nova-compute[73067]: </disk>
Aug 16 11:32:19 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:32:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692185539.974171, 6521c88d-b213-4949-8a86-7c3d6e2d09b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 11:32:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 11:32:19 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Successfully detached device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the live domain config.
Aug 16 11:32:19 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:32:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqdjnlpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:32:19 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:32:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:32:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:32:19 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:32:19 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc060f2d-04e4-4738-a551-9675d6194a37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa66da0e-8df9-444e-b9fb-b760021956a6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 (non-flash)
Aug 16 11:32:20 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 (non-flash)
Aug 16 11:32:20 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35843916c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41e5380-9798-49c0-97b7-b44cdfdf6786]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65cfdbe-b8ee-47a4-ada4-075a33995e09]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19cf9c3-a24d-4d4e-9dd0-d037a02bb4f0]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccf6668-29c4-4b51-b257-93bd36eb9d94]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[db314044-2287-45be-a5a9-7be88956cb88]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[69288dfe-f511-4cb8-8b7d-39b224bc115c]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13, portal: 172.16.0.220,3260]
Aug 16 11:32:20 user nova-compute[73067]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13, portal: 172.16.0.220,3260] successful.
Aug 16 11:32:20 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b44d48-7558-4f7d-adf9-8a638574bf13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd96cf0-0ed1-4b39-a9fe-a8c6494b9215]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== disconnect_volume: return (287ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:32:20 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:32:21 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:32:21 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f69d412d-4023-4237-a67d-d17ab8ff4245 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.644s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:32:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:32:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:32:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:32:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:32:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:32:26 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:32:26 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:32:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8801MB free_disk=25.100479125976562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:32:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:32:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:33 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:32:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:32:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:32:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:32:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:32:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:32:33 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:32:33 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:32:33 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:32:33 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:32:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:32:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:32:38 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:32:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:32:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:32:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:32:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:32:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:32:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:33:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:33:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:33:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:33:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:33:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:33:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:33:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:33:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG nova.objects.instance [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:33:13 user nova-compute[73067]: INFO nova.compute.manager [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attaching volume 7a43033f-c418-4035-9c31-d95b4c2da004 to /dev/vdb
Aug 16 11:33:13 user nova-compute[73067]: DEBUG os_brick.utils [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa92e85-a780-4db5-966e-699bb10db774]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[899c64fc-732c-4b77-a210-8687c1e5bd19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee83865-0864-47f6-ab16-5471b024fe6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfcbb15-d111-4b1b-8882-c55dfaacb985]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:33:13 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:33:13 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acb10f8-96fa-45ff-999f-94741abe8a53]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG os_brick.utils [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:33:13 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating existing volume attachment record: c0bce9b0-1808-4cba-bdaf-34c89c6aa62e {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:33:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:33:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:33:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:33:19 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:33:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:33:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:33:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:26 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:33:26 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:33:26 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=25.099735260009766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:33:26 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:33:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:33:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:33:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:33:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:33:27 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:33:27 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:33:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:33:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAGkDtUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:33:29 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:33:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:33:29 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:33:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:33:29 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[011f4366-d1b8-441a-ab3c-f4882f3e5d90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:33:29 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc0b114-5feb-4dcf-bcf5-e10f3d800b22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004] added
Aug 16 11:33:29 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2baa41f-20b6-45ac-9c3a-eba97943386d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc15cdfa-adb3-419f-a873-bff62091bd83]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAGkDtUE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAGkDtUE" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d19bd9-d7b3-4ee9-b190-5da369ac84b5]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OAGkDtUE'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f5b9e4-2af6-4d05-87ab-758763a36af2]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a045a8-6a4a-4127-afa8-1cb01704d044]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:33:30 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:33:30 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:33:30 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 11:33:30 user nova-compute[73067]: 
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[40346989-d67b-4c54-9b31-826dd01113f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004, portal: 172.16.0.220,3260]
Aug 16 11:33:30 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004, portal: 172.16.0.220,3260] successful.
Aug 16 11:33:30 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf00156-7327-406b-9e4e-376b68b3b187]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f271953-d447-472f-93e2-5aea990932df]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 (non-flash)
Aug 16 11:33:30 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 (non-flash)
Aug 16 11:33:30 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ef82fb-4d4a-4829-a172-3037a1fed362]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:33:30 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAGkDtUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:33:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:33:31 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26163366462396265', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:33:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163366462396265', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:33:31 user nova-compute[73067]: DEBUG nova.objects.instance [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:33:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 11:33:31 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:33:31 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:33:31 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:33:31 user nova-compute[73067]:   <serial>7a43033f-c418-4035-9c31-d95b4c2da004</serial>
Aug 16 11:33:31 user nova-compute[73067]: </disk>
Aug 16 11:33:31 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 11:33:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:33:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:33:31 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No VIF found with MAC fa:16:3e:41:7d:1a, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:33:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-16cf4b13-d0da-4f09-b836-23da20ce9137 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.247s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:33:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:33:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:33:34 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:33:34 user nova-compute[73067]: INFO nova.compute.manager [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Detaching volume 7a43033f-c418-4035-9c31-d95b4c2da004
Aug 16 11:33:34 user nova-compute[73067]: INFO nova.virt.block_device [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attempting to driver detach volume 7a43033f-c418-4035-9c31-d95b4c2da004 from mountpoint /dev/vdb
Aug 16 11:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Attempting to detach device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 11:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:33:34 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:33:34 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:33:34 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:33:34 user nova-compute[73067]:   <serial>7a43033f-c418-4035-9c31-d95b4c2da004</serial>
Aug 16 11:33:34 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:33:34 user nova-compute[73067]: </disk>
Aug 16 11:33:34 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:33:34 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Successfully detached device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the persistent domain config.
Aug 16 11:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 11:33:34 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:33:34 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:33:34 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:33:34 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:33:34 user nova-compute[73067]:   <serial>7a43033f-c418-4035-9c31-d95b4c2da004</serial>
Aug 16 11:33:34 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:33:34 user nova-compute[73067]: </disk>
Aug 16 11:33:34 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692185615.2408466, 6521c88d-b213-4949-8a86-7c3d6e2d09b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 11:33:35 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Successfully detached device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the live domain config.
Aug 16 11:33:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAGkDtUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:33:35 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa73486-a991-42ef-b2da-7a93eb6581ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd2671-e6ee-4540-ad64-39d578b6c641]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 (non-flash)
Aug 16 11:33:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 (non-flash)
Aug 16 11:33:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f356462d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef7cefb-2a46-490c-b114-e5f1584edf87]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f715c62-639b-4173-9622-8982c006c519]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fdaf43-12b4-48de-b867-7f08028be089]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[972df3b1-1bde-4552-a9fe-a1319c45ee98]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fe5447-41da-42e8-94e2-21441c121f67]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6761e1-a6dd-43f9-9c0c-0af703cca563]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004, portal: 172.16.0.220,3260]
Aug 16 11:33:35 user nova-compute[73067]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004, portal: 172.16.0.220,3260] successful.
Aug 16 11:33:35 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a43033f-c418-4035-9c31-d95b4c2da004 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[86169022-3213-4eb8-93d9-79918dd2c137]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== disconnect_volume: return (254ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:33:35 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:33:36 user nova-compute[73067]: DEBUG nova.objects.instance [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:33:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-9b39208f-b6cd-4aa5-aa10-c419631ce117 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.543s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:33:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:33:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:33:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:33:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:33:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:33:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:33:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:33:38 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:33:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:33:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:33:40 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:33:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:33:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:33:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:33:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:34:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:18 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:34:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:34:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:27 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:34:27 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:34:27 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=25.098831176757812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:34:27 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG nova.objects.instance [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:34:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:34:29 user nova-compute[73067]: INFO nova.compute.manager [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attaching volume e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 to /dev/vdb
Aug 16 11:34:29 user nova-compute[73067]: DEBUG os_brick.utils [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a70553-458b-441b-9735-732550d30dd9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f936b25c-dff8-4cc8-90f8-662a2aa13eb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4e6b84-6451-4286-be18-1b60096049b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c759bdd-c049-4010-ade2-66ee7740c7a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:34:29 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:34:29 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f74437-9ba6-489f-882b-794d77fdaeef]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG os_brick.utils [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:34:29 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating existing volume attachment record: 5677a75f-ef84-4f21-95cb-3af24a0bd915 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:34:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:34:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:36 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:34:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:34:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:34:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:34:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:34:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:34:36 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:34:36 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:34:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:34:36 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:34:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgsHIxED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:34:38 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:34:38 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:34:38 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[983cff31-ac35-4a82-a33a-7380bec7cc6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:34:38 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a679a649-6d59-43d9-b35f-66e643eef60d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2] added
Aug 16 11:34:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[259085a1-b91e-4dc3-9f3c-ae4a01d68c0c]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63c2052-c432-42b2-817c-fda848555e83]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgsHIxED {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgsHIxED" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[355e2ddd-c223-4422-8e44-2b84b2d9096b]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OgsHIxED'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10315b0-6dcb-4d5a-a404-83b6ee7a4be3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7a4380-1de4-43ce-a26c-2e8e3e15303c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:34:38 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:34:38 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:34:38 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 11:34:38 user nova-compute[73067]: 
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f541cd-f764-453e-9a6a-b949ef007230]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2, portal: 172.16.0.220,3260]
Aug 16 11:34:38 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2, portal: 172.16.0.220,3260] successful.
Aug 16 11:34:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae9ef5d-3b7f-4108-bcab-a9ea8986cf00]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[26230c98-3fee-445c-91ae-d605a09f2b74]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 (non-flash)
Aug 16 11:34:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 (non-flash)
Aug 16 11:34:38 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[36774765-6147-47f3-808d-5403bd902ffc]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:38 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:34:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:34:39 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:34:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgsHIxED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:34:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:34:39 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26330636534343661', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:34:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330636534343661', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:34:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:34:39 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 11:34:39 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:34:39 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:34:39 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:34:39 user nova-compute[73067]:   <serial>e4dc0b70-c05f-4187-b94a-7ead3dce3cc2</serial>
Aug 16 11:34:39 user nova-compute[73067]: </disk>
Aug 16 11:34:39 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 11:34:40 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:34:40 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:34:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:34:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:34:40 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No VIF found with MAC fa:16:3e:41:7d:1a, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:34:40 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-253fed0d-648b-4b68-8b1f-a174eba11e96 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.467s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:34:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:34:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:34:42 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:34:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:42 user nova-compute[73067]: INFO nova.compute.manager [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Detaching volume e4dc0b70-c05f-4187-b94a-7ead3dce3cc2
Aug 16 11:34:42 user nova-compute[73067]: INFO nova.virt.block_device [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attempting to driver detach volume e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 from mountpoint /dev/vdb
Aug 16 11:34:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Attempting to detach device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 11:34:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:34:42 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:34:42 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:34:42 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:34:42 user nova-compute[73067]:   <serial>e4dc0b70-c05f-4187-b94a-7ead3dce3cc2</serial>
Aug 16 11:34:42 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:34:42 user nova-compute[73067]: </disk>
Aug 16 11:34:42 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:34:42 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Successfully detached device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the persistent domain config.
Aug 16 11:34:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 11:34:42 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:34:42 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:34:42 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:34:42 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:34:42 user nova-compute[73067]:   <serial>e4dc0b70-c05f-4187-b94a-7ead3dce3cc2</serial>
Aug 16 11:34:42 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:34:42 user nova-compute[73067]: </disk>
Aug 16 11:34:42 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692185683.0851886, 6521c88d-b213-4949-8a86-7c3d6e2d09b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 11:34:43 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Successfully detached device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the live domain config.
Aug 16 11:34:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgsHIxED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:34:43 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7fb36c-794c-41a0-a8a8-8f795b3f9afd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b91212-1c05-4f68-b495-14f7f32ef974]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 (non-flash)
Aug 16 11:34:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 (non-flash)
Aug 16 11:34:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642b6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad46655-101e-492a-9d5d-edecf76b1917]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[49968b34-7b70-4cb1-980a-70424100a13f]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c3cd36-c9e0-47cc-b8dc-49c196e22fd0]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f819490-b76a-4177-9d91-e085f922f43f]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b45b19-aaf5-4b24-be8d-865033e5f4d8]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf921be-bbe3-4c4a-a0a8-2e37c14af86a]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2, portal: 172.16.0.220,3260]
Aug 16 11:34:43 user nova-compute[73067]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2, portal: 172.16.0.220,3260] successful.
Aug 16 11:34:43 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4dc0b70-c05f-4187-b94a-7ead3dce3cc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[39152d66-e295-46b1-9406-1ee7d9f967ac]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== disconnect_volume: return (270ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:34:43 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:34:44 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:34:44 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e7dc9d48-4ceb-457e-b0a1-447f33e2ff68 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:34:45 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:34:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:34:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:35:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:19 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:35:21 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:35:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:25 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:35:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:35:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:35:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:35:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:35:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:28 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:35:28 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:35:28 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8813MB free_disk=25.097869873046875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:35:28 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:35:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:35:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:35:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:35:29 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:35:29 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:35:29 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:35:29 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:35:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:35:36 user nova-compute[73067]: DEBUG nova.objects.instance [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:35:36 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:35:36 user nova-compute[73067]: INFO nova.compute.manager [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attaching volume 5e1dcfb2-113c-438b-897e-321b9bc0e339 to /dev/vdb
Aug 16 11:35:37 user nova-compute[73067]: DEBUG os_brick.utils [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dc83a9-8b32-4878-82f9-defced926049]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cea38eecf368\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[498442fd-9da6-47a8-85e9-2e8ceb05c0df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0692db9d-dbcb-4909-9edc-cd8351dc13bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e740f02-a0aa-4cb1-90df-d8fd50265dda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Running cmd (subprocess): nvme version {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] 'nvme version' failed. Not Retrying. {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] nvme not present on system {{(pid=73067) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 11:35:37 user nova-compute[73067]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 11:35:37 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cbf856-ba52-4ea9-a366-26d63c2a9268]: (4, '') {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73067) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.lightos [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] LIGHTOS: no hostnqn found. {{(pid=73067) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG os_brick.utils [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cea38eecf368', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG nova.virt.block_device [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating existing volume attachment record: e22243e3-8209-46f9-8baf-0e8482e4f2f5 {{(pid=73067) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 11:35:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:38 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:35:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:35:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:35:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:35:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:35:38 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:35:38 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:35:38 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:35:38 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:35:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:35:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:35:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:35:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:35:42 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:35:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Calling os-brick to attach iSCSI Volume {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCljArzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:35:46 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:35:46 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:35:46 user nova-compute[73067]: INFO os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[af672900-8727-4a17-8954-790d1a37617f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 11:35:46 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --interface default --op new {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1478654-9354-4d8d-a5da-ad43ce9f0269]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339] added\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339] added
Aug 16 11:35:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba988d4f-2645-45e3-9b49-89f9108937ef]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[304aada0-3eb7-4c71-a4f9-4a3f6e7b8ac8]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCljArzP {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCljArzP" returned: 0 in 0.023s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7cb6b5-5663-49e1-9146-d2b8f55a5f8d]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCljArzP'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[0300507b-5223-4694-964a-e3e73ba7a59e]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc9a5a4-ccb9-42c1-bea9-e0143b457093]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:35:46 user nova-compute[73067]:  {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 11:35:46 user nova-compute[73067]:  {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:35:46 user nova-compute[73067]: WARNING os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 11:35:46 user nova-compute[73067]: 
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --login {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b8ad8d-7991-4579-ad9e-7a53dab58fad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339, portal: 172.16.0.220,3260]
Aug 16 11:35:46 user nova-compute[73067]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339, portal: 172.16.0.220,3260] successful.
Aug 16 11:35:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[44712f72-ff46-4816-aaca-7b03a22d035a]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27efb01-4e00-4414-82bf-81e227e6aa7d]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 (non-flash)
Aug 16 11:35:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 (non-flash)
Aug 16 11:35:46 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Connected to 172.16.0.220:3260 {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73067) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73067) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[85076264-3a0d-4e5c-b389-ab583123d499]: (4, ('- - 0', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73067) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 11:35:46 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCljArzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73067) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26637366262363363', 'path': '/dev/sdb'} {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637366262363363', 'path': '/dev/sdb'} {{(pid=73067) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG nova.objects.instance [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:35:47 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 11:35:47 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:35:47 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:35:47 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:35:47 user nova-compute[73067]:   <serial>5e1dcfb2-113c-438b-897e-321b9bc0e339</serial>
Aug 16 11:35:47 user nova-compute[73067]: </disk>
Aug 16 11:35:47 user nova-compute[73067]:  {{(pid=73067) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 11:35:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No BDM found with device name vda, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:35:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73067) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 11:35:48 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] No VIF found with MAC fa:16:3e:41:7d:1a, not building metadata {{(pid=73067) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 11:35:48 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-c40f2b5b-61de-42f0-9704-c4404618382f tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.415s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:35:50 user nova-compute[73067]: INFO nova.compute.manager [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Detaching volume 5e1dcfb2-113c-438b-897e-321b9bc0e339
Aug 16 11:35:50 user nova-compute[73067]: INFO nova.virt.block_device [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Attempting to driver detach volume 5e1dcfb2-113c-438b-897e-321b9bc0e339 from mountpoint /dev/vdb
Aug 16 11:35:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Attempting to detach device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the persistent domain config. {{(pid=73067) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:35:50 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:35:50 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:35:50 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:35:50 user nova-compute[73067]:   <serial>5e1dcfb2-113c-438b-897e-321b9bc0e339</serial>
Aug 16 11:35:50 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:35:50 user nova-compute[73067]: </disk>
Aug 16 11:35:50 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:35:50 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Successfully detached device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the persistent domain config.
Aug 16 11:35:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the live domain config. {{(pid=73067) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.guest [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 11:35:50 user nova-compute[73067]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 11:35:50 user nova-compute[73067]:   <source dev="/dev/sdb"/>
Aug 16 11:35:50 user nova-compute[73067]:   <target dev="vdb" bus="virtio"/>
Aug 16 11:35:50 user nova-compute[73067]:   <serial>5e1dcfb2-113c-438b-897e-321b9bc0e339</serial>
Aug 16 11:35:50 user nova-compute[73067]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 11:35:50 user nova-compute[73067]: </disk>
Aug 16 11:35:50 user nova-compute[73067]:  {{(pid=73067) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-8879f7ea-d042-40fb-b224-58bd7c0f6286 None None] Received event <DeviceRemovedEvent: 1692185750.9317198, 6521c88d-b213-4949-8a86-7c3d6e2d09b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73067) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.driver [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 11:35:50 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Successfully detached device vdb from instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 from the live domain config.
Aug 16 11:35:50 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] calling os-brick to detach iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35646360e0>, {'target_iqns': ['iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCljArzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 11:35:50 user nova-compute[73067]: WARNING os_brick.initiator.connectors.base [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 11:35:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339', 0)] {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1691cba-7d94-4d61-85f2-cb40b27087b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b47ab4-fc78-448e-9d1a-789162ee211f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 (non-flash)\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 (non-flash)
Aug 16 11:35:50 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 11:35:50 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 (non-flash)
Aug 16 11:35:50 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35642cf520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339'): ({'sdb'}, set())}) {{(pid=73067) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Removing single pathed devices sdb {{(pid=73067) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.042s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[e630a2e9-3367-418a-8050-ce7ae134dcf3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdebde4-61d6-4c8f-9680-21446350dc90]: (4, ('ok\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Flushing IO for device /dev/sdb {{(pid=73067) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[a455e291-60bf-4513-b1b7-75591dcd41b3]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73067) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[de95d41c-5d7d-4e99-9bc0-2eab2c6d5dda]: (4, ('1', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.linuxscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] SCSI volumes sdb have been removed. {{(pid=73067) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339')] {{(pid=73067) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2041559-65b4-453d-b1cb-a72632f1f973]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --logout {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e173f4-034c-422a-b6f5-26cef03e3a44]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339, portal: 172.16.0.220,3260]
Aug 16 11:35:51 user nova-compute[73067]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339, portal: 172.16.0.220,3260] successful.
Aug 16 11:35:51 user nova-compute[73067]:  stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op delete {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e1dcfb2-113c-438b-897e-321b9bc0e339 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG oslo.privsep.daemon [-] privsep: reply[8813ad7f-b294-417e-8273-1d3c0276e34f]: (4, ('', '')) {{(pid=84181) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73067) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.base [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] <== disconnect_volume: return (284ms) None {{(pid=73067) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 11:35:51 user nova-compute[73067]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Disconnected iSCSI Volume {{(pid=73067) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 11:35:52 user nova-compute[73067]: DEBUG nova.objects.instance [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'flavor' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:35:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-f3ea7aa3-c592-457b-aa1f-f914566af820 tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:35:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:35:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:36:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:36:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:36:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:36:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:36:19 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:36:23 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:27 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:36:29 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG oslo_concurrency.processutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73067) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 11:36:30 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:36:30 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:36:30 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.096858978271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:36:30 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:36:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73067) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 11:36:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:36:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:36:31 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:36:31 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:36:31 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:36:31 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:36:32 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:36:35 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:37 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquired lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Forcefully refreshing network info cache for instance {{(pid=73067) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG nova.objects.instance [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lazy-loading 'info_cache' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG nova.network.neutron [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [{"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Releasing lock "refresh_cache-6521c88d-b213-4949-8a86-7c3d6e2d09b1" {{(pid=73067) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updated the network info_cache for instance {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:39 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73067) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 11:36:40 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:42 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:36:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:44 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:36:47 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:47 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Triggering sync for uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:36:52 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:36:57 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:00 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:37:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Cleaning up deleted instances {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 11:37:00 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] There are 0 instances to clean {{(pid=73067) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 11:37:02 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:07 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:12 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:37:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:20 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:37:22 user nova-compute[73067]: INFO nova.compute.manager [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Terminating instance
Aug 16 11:37:22 user nova-compute[73067]: DEBUG nova.compute.manager [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Start destroying the instance on the hypervisor. {{(pid=73067) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:22 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG nova.compute.manager [req-5b846da6-29c7-44f3-8bdd-98072d18e4dd req-3325c23f-6ebe-430f-8dc2-e7bb790a819f service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received event network-vif-unplugged-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5b846da6-29c7-44f3-8bdd-98072d18e4dd req-3325c23f-6ebe-430f-8dc2-e7bb790a819f service nova] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5b846da6-29c7-44f3-8bdd-98072d18e4dd req-3325c23f-6ebe-430f-8dc2-e7bb790a819f service nova] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-5b846da6-29c7-44f3-8bdd-98072d18e4dd req-3325c23f-6ebe-430f-8dc2-e7bb790a819f service nova] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG nova.compute.manager [req-5b846da6-29c7-44f3-8bdd-98072d18e4dd req-3325c23f-6ebe-430f-8dc2-e7bb790a819f service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] No waiting events found dispatching network-vif-unplugged-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG nova.compute.manager [req-5b846da6-29c7-44f3-8bdd-98072d18e4dd req-3325c23f-6ebe-430f-8dc2-e7bb790a819f service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received event network-vif-unplugged-199d1436-4a6e-4025-a700-a7670dad2be8 for instance with task_state deleting. {{(pid=73067) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:23 user nova-compute[73067]: INFO nova.virt.libvirt.driver [-] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Instance destroyed successfully.
Aug 16 11:37:23 user nova-compute[73067]: DEBUG nova.objects.instance [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lazy-loading 'resources' on Instance uuid 6521c88d-b213-4949-8a86-7c3d6e2d09b1 {{(pid=73067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG nova.virt.libvirt.vif [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T11:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-911559297',display_name='tempest-SnapshotDataIntegrityTests-server-911559297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-911559297',id=52,image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/FyAPxXC9SreaP8WZdGdKlCvnIwf6JF0BUs7ZOPvZ3RJigYwlykf6sxafNCmCMMCQMNYpH6XseaZqOIVPRWLFRphgNIAtDUNvUAmvqtWiZ5feBKk5Lg6DqZAfMp6ZAlA==',key_name='tempest-keypair-736801926',keypairs=<?>,launch_index=0,launched_at=2023-08-16T11:29:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='261b57c7ca8648d3ac70fcf0c6f9b710',ramdisk_id='',reservation_id='r-iay7rere',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d4ee16f-96ca-4a0a-a30f-3c76ef58cb58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1932441878',owner_user_name='tempest-SnapshotDataIntegrityTests-1932441878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T11:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a21b8af065024013bed5da238eed6d8a',uuid=6521c88d-b213-4949-8a86-7c3d6e2d09b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Converting VIF {"id": "199d1436-4a6e-4025-a700-a7670dad2be8", "address": "fa:16:3e:41:7d:1a", "network": {"id": "7006659b-ccfb-4f77-ad58-74f7af05ec67", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1776105899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "261b57c7ca8648d3ac70fcf0c6f9b710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap199d1436-4a", "ovs_interfaceid": "199d1436-4a6e-4025-a700-a7670dad2be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG nova.network.os_vif_util [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=199d1436-4a6e-4025-a700-a7670dad2be8,network=Network(7006659b-ccfb-4f77-ad58-74f7af05ec67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap199d1436-4a') {{(pid=73067) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG os_vif [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=199d1436-4a6e-4025-a700-a7670dad2be8,network=Network(7006659b-ccfb-4f77-ad58-74f7af05ec67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap199d1436-4a') {{(pid=73067) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap199d1436-4a, bridge=br-int, if_exists=True) {{(pid=73067) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:37:23 user nova-compute[73067]: INFO os_vif [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=199d1436-4a6e-4025-a700-a7670dad2be8,network=Network(7006659b-ccfb-4f77-ad58-74f7af05ec67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap199d1436-4a')
Aug 16 11:37:23 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Deleting instance files /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1_del
Aug 16 11:37:23 user nova-compute[73067]: INFO nova.virt.libvirt.driver [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Deletion of /opt/stack/data/nova/instances/6521c88d-b213-4949-8a86-7c3d6e2d09b1_del complete
Aug 16 11:37:23 user nova-compute[73067]: INFO nova.compute.manager [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 16 11:37:23 user nova-compute[73067]: DEBUG oslo.service.loopingcall [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73067) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG nova.compute.manager [-] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Deallocating network for instance {{(pid=73067) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 11:37:23 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] deallocate_for_instance() {{(pid=73067) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 11:37:24 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:37:24 user nova-compute[73067]: DEBUG nova.network.neutron [-] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Updating instance_info_cache with network_info: [] {{(pid=73067) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 11:37:24 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Took 1.17 seconds to deallocate network for instance.
Aug 16 11:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:37:24 user nova-compute[73067]: DEBUG nova.compute.manager [req-868283f8-36ad-42a1-a258-47227508212f req-784e1874-9f25-453e-8fa9-dfa9cec379fa service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received event network-vif-deleted-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:37:24 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:37:24 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:37:24 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:37:24 user nova-compute[73067]: INFO nova.scheduler.client.report [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Deleted allocations for instance 6521c88d-b213-4949-8a86-7c3d6e2d09b1
Aug 16 11:37:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-3b20c1b7-fc3e-4a82-a4b7-f5b1721f350a tempest-SnapshotDataIntegrityTests-1932441878 tempest-SnapshotDataIntegrityTests-1932441878-project-member] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.388s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:37:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-6485585a-2a42-40fc-b4f4-1cff2c9fab3e req-34c5324d-794a-41c4-9c06-aae16d430fbb service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received event network-vif-plugged-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 11:37:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6485585a-2a42-40fc-b4f4-1cff2c9fab3e req-34c5324d-794a-41c4-9c06-aae16d430fbb service nova] Acquiring lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:37:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6485585a-2a42-40fc-b4f4-1cff2c9fab3e req-34c5324d-794a-41c4-9c06-aae16d430fbb service nova] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:37:25 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [req-6485585a-2a42-40fc-b4f4-1cff2c9fab3e req-34c5324d-794a-41c4-9c06-aae16d430fbb service nova] Lock "6521c88d-b213-4949-8a86-7c3d6e2d09b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:37:25 user nova-compute[73067]: DEBUG nova.compute.manager [req-6485585a-2a42-40fc-b4f4-1cff2c9fab3e req-34c5324d-794a-41c4-9c06-aae16d430fbb service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] No waiting events found dispatching network-vif-plugged-199d1436-4a6e-4025-a700-a7670dad2be8 {{(pid=73067) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 11:37:25 user nova-compute[73067]: WARNING nova.compute.manager [req-6485585a-2a42-40fc-b4f4-1cff2c9fab3e req-34c5324d-794a-41c4-9c06-aae16d430fbb service nova] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Received unexpected event network-vif-plugged-199d1436-4a6e-4025-a700-a7670dad2be8 for instance with vm_state deleted and task_state None.
Aug 16 11:37:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:37:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:37:32 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:37:32 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=25.116119384765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing inventories for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating ProviderTree inventory for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Updating inventory in ProviderTree for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing aggregate associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, aggregates: None {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Refreshing trait associations for resource provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=73067) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:37:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:37:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:37:38 user nova-compute[73067]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692185843.4283597, 6521c88d-b213-4949-8a86-7c3d6e2d09b1 => Stopped> {{(pid=73067) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 11:37:38 user nova-compute[73067]: INFO nova.compute.manager [-] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] VM Stopped (Lifecycle Event)
Aug 16 11:37:38 user nova-compute[73067]: DEBUG nova.compute.manager [None req-5586f128-dce0-44c4-85a2-2ef6ca0ecb7c None None] [instance: 6521c88d-b213-4949-8a86-7c3d6e2d09b1] Checking state {{(pid=73067) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 11:37:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:37:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:37:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:37:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:37:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:41 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:37:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:37:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:37:41 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:37:42 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:37:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:37:44 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:37:45 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:37:45 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73067) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 11:37:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:37:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:37:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:37:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:37:48 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:53 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:37:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:37:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:37:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:37:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:37:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:37:58 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:03 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:08 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:38:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:13 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:17 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:18 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:20 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:22 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:38:23 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:26 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:38:27 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:38:28 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:31 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Auditing locally available compute resources for user (node: user) {{(pid=73067) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 11:38:32 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:38:32 user nova-compute[73067]: WARNING nova.virt.libvirt.driver [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 11:38:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Hypervisor/Node resource view: name=user free_ram=9080MB free_disk=25.11313247680664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73067) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73067) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG nova.compute.provider_tree [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed in ProviderTree for provider: 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f {{(pid=73067) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG nova.scheduler.client.report [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Inventory has not changed for provider 7a48dc9d-34af-4b2f-a024-e5f63ad8ce3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73067) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG nova.compute.resource_tracker [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Compute_service record updated for user:user {{(pid=73067) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 11:38:32 user nova-compute[73067]: DEBUG oslo_concurrency.lockutils [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=73067) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 11:38:33 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:38:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 11:38:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73067) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 11:38:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:38:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73067) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 11:38:38 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:43 user nova-compute[73067]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73067) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 11:38:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 11:38:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Starting heal instance info cache {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 11:38:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Rebuilding the list of instances to heal {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 11:38:43 user nova-compute[73067]: DEBUG nova.compute.manager [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Didn't find any instances for network info cache update. {{(pid=73067) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 11:38:43 user nova-compute[73067]: DEBUG oslo_service.periodic_task [None req-e1544416-f949-49bf-ace5-ac191f1c5b54 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73067) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}